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ABSTRACT 


This rsport dssls wich progrsss toads on Chs Grant NSG-SO'tS during ths 
cwalva month period beginning Octobsr 1, 1980 and sndlng Ssptambsr 30, 1981. 
Ths NASA Technical Officer for this period was Dr. Kurt Seldner of Lewis 
Research Center. The director of the research at the University of Nutre 
Dame was Dr. Michael K. ialn, who has been assisted by Mr. Stephen Yurkovlch, 
Mr. Joe P. Hill, and Mr. Thomas A. Kllngler, research assistants. In the 
Department of Electrical Engineering. Mr. Yurkuvlch received the degree 
of Master of Science c^tring this period, for his January 1981 thesis en- 
titled "Application of Tensot Ideas to Nonlinear Modeling and Control". 

Mr. Hill and Mr. Kllngler expect to complete research investigations for 
the Master of Science degree within Che next calendar year. Mr. Yurkovlch 
may complete requirements for the degree of Doctor of Philosophy In 1982. 

Researches during the preceding calendar year have centered on basic 
topics In Che modeling and feedback control of nonlinear dynamical systems. 

Of special Interest have been the following topics: (1) the role of series 

descriptions, especially Insofar as they relate to questions of scheduling. 

In Che control of gas turbine engines; (2) the use of algebraic tensor 
theory as a technique for parameterizing such descriptions; (3) the rela- 
tionship between censor methodology and ocher parts of the nonlinear lit- 
erature; (4) the improvement of interactive methods for parameter selection 
within a censor viewpoint; and (3) study of feedback gain representation 
as a counterpart to these modeling and parameterization Ideas. 

Progress has been made In all five of the areas just described. Of 
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special Incarast. we believe, are Che natural design ties which exist be- 
tween scheduling and series representations and Che natural mathematical 
ties which exist between symmetric censor representations and formal series. 
In the light of rapidly evolving capabilities of microcomputers and mini- 
computers, in view of the qualitative Censor model possibilities estab- 
lished by Mr. Yurkovlch in M.S. studies, and caking into account both the 
state of Che art and prospects for further advance in censor techniques 
for feedback from such models, we believe that significant opportunities 
for research progress are occurring in this area. 
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I. BACKGROUND 


1.1 INTRODUCTION 

In chla raport, we diacuaa prograaa which haa bean made on NASA Grant 
NSG-3048, entitled "Altematlvaa for Jet Engine Control”, during the 
twelve month period beginning on October 1, 1980 and ending on September 
30. 1981. 

Thla aectlon contalna. In aubaectlons ).2 and 1.3, aome mathematical 
background material, which may be uaeful for reference during an examina- 
tion of later aectlona. 

Section II reporta on the reaulta of an extenalve literature examin- 
ation carried out by Mr. Stephen Yurkovlch. This material explalna many 
of the relatlonshlpa between the theoretical machinery In uae under this 
grant and various other methodologies Involved in other theoretical 
studies. Insofar as we can determine, this group remains the pioneer In 
assessing practical utility of such methods for use In realistic appli- 
cation simulations. This means that our viewpoint and evaluation may be 
weighted In a manner different from chat of the pure theoretical investi- 
gator. 

Section III treats In an Introductory way the polynomlc and formal 
series implications of controller scheduling. The practical process of 
scheduling linear multivariable controllers leads naturally to families 
such as chose which we have under investigation. 

Section IV gives an update on Che group's progress in developing 
parameter selection methods for choosing coefficients In censor represen- 


e«eion*. Tnis work has baan carrlad out by Mr. Thomas Kllnglar. As will 
ba apparanc in cha comparison of prasanc capabilitias with Chcaa of last 
yaar, a numbar of vary positiva staps hava baan takan. Wa axpact thasa 
staps to ba of considarabla assistanca in subsaquant work. 

Saction V daals with tha usa of faadback on nonlinaar tansor dynamical 
modals. This study is in tha formativa stagas and is baing carriad out by 


Mr. Joa Hill. 


1.2 AB STRACT DIFFERENTUTION 


As vlll b« indicated in Section 3.2, the idee of pclynomic icheduling, 
of gains or time constants, suggests a state description in terms of series. 
Because we wish to use operator theoretic methods to some extent, it is 
convenient here to ask a few Introductory questions about derivatives in 
such a context. 

Let V and W be normed real vector spaces, with Z open in V. 

A function t : Z V is differentiable at a point p in Z if there 
exists a continuous linear map F : V -v w such that, for (p4-h) in Z 
and h in V, 

llm llt(yHi) - t(p) - Fh.ll .. j 

IlhiN MM( 

If F exists, then it is unique and is called the derivative of f at 
p, and is denoted by 

(Df)(p) : V - W . 

In case f is dlffereutlable on Z, then we have a construuclon 

Df : Z L(V,W) , 

where L(V,W) denotes the real vector space of IR-linear maps V W. 

Higher order derivatives are defined in a recursive fashion, 

(D"f)(p) - (D(o’'"^f))(p) , 

with r a positive Integer, provided that the indicated limit exists. 

An important connection exists between the calcuiiis on normed vector 
spaces and the tensor algebra. Indeed, 

D^f(p) e L(V,L(V.M)) , 

D^f(p) e L(V,L(V,L(V,W))) 
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«^«n«v«r ch« llmica «xl«c. Ldt ua d«not« by 

LCV^.Vj V^,V) 

the rtal vector apace of n- linear functlona 

V, * V, * . . . X ■* W , 
i £ n 

an n>llnear function being one which la linear In Ita r«&alnlng arguawnt 
whenever (n-1) of Ita argumenta are fixed. It can be ahown that there 
exlat laooorphlama 

L(V^,V2,M) ^ L(V^,L(V2,W)) , 

L(VyV^,VyV) ■*. L(V^,L(V2,L(V2,W))) , 


ao that (o’^fXp) can be regarded aa an r-llnear map •*> W, up to lao- 
morphism. We suppreaa ,^ia laomorphlam and think of (D f)(p) as Just 
such a map. 

It la now straightforward to establish a connection with the tensor 
algebra, and we do so In the section following. The Importance of the 
connection lies in Itn parametric possibilities: Every r-llnear map can 

be composed from a linear map and a universal r- linear construction called 
tensor product. In a sense, the linear map embodies the parameters which 
are available for scheduling; and we pursue this view In a later section. 
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1.3 TENSOR ALGEBRA 


In this scccion, w« develop sooe of the structure.^ with which we cen 
Bubeequently dlBC\..'‘s echedullng queetione in Section 3.3. Let V be e 
reel vector epece. For eech integer r which is two or greeter, let 

(•"^V, •') 

be e tensor product for r copies of V. The notion extends to 1 end 0 
by the definitions 

- V , e°V - R . 

The sequence •’^V, r - 0,1,2 cen be developed into e biproduct, end 

the ioeges of under insertion cen bo given the seme notetion. Then 

the tensorial powers •'V cen be developed into an essocietlvo elgebre by 
defining the Internal direct sum 

•V - I •"v , 
n-0 

end by equipping *V with the bill'<eer mapping (<s,S) aS for a, S, 

« e V whose result is defined by 

aS - I a_ • t 

n,m 

where 0 i"ya,B-yS for o € and With this multl- 

^ n m n m 

n m 

plication, ev becomes the graded tensor algebra over V with elements 
(Oq, Oj^,...), which are sequences of the tensors « *‘V, 1 - 0,1,..., 
and with unit element (1,0,...). We emphasize the fact that multiplica- 
tion in the tensor algebra is not a rensor product. 

Now let 9V and eW be tensor algebras as defined above, over V 
and W respectively. For every pair n, m 2 1, let «”(V,W) be a tensor 
product of and ®®W, that is. 


•”(V,W) - (•‘V) • (•®W) . 

m 

W« sat •J?(V,W) ■ •”v «id •^(V.W) • In a oannar similar to chat 

U w 

pracadlng, 

^ * 0,1.2,..., m ■ 0,1,2,... 

iB 

can also ba davalopad Into a blproduct; and tha Imagas of aach of thaaa 
spacas undar natural Insartlon Into tha blproduct can again ba glvan tha 
sama symbolic raprasantatlon. Again, than, wa construct tha Intarnal dlract 
sum 

m 

•<V,W) - y •"(V,M) 

^ to 
n,m20 

with 

m 

•(V,W) -It! •"(V.W)] 
k-0 n-fm-k “ 

functioning as tha Inducad gradation on m(V,W). 

Now consldar two spacas •”(V,W) and •’^(V,W). Thara axlots a unlqua 

ms 

blllnaar mapping 

u : «^(V,W) X •g(V,W) - »J^g(V,W) 

with action 


p(qi 9 8 , a • 8 ) - (a « a ) « (8„ « 3 ) , 
nmrs nr ms 

whara a^ e •‘V, a. « •’^V, 8 « •“w, 8 « «*W. The pair («^’^(V,W) ,u) la 

r. r m 8 

a tansor product, or 

- ®”(V,W) • «^(V,W) 
dts m s 

and 


(a « a ) *, (8„ « 8„) 
n rim s 


(a • 8 J 
n m 


(ar ® 3g) . 
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W« havt tubscripccd ch« produce symbol • in this •quatlon in order to 
emphasize Che face chat Che defining produce on Che lefe side is be- 
Cween an (n^Hr)- Censor and an (mfs)-censor , while Che defined produce 
on Che rlghc is becween an (n-Hn)-censor and an (r4-s)-censor. 


An algebra scruccure may be placed on *(V,W) by defining a mulcl- 

pllcaeion operaclon. To chis end, ItC a” 6 •*'(V,M) and 8^ e «^(V,W) 

mm as 

so chac ch*i censors 


o 


I 

n,m 


n 


a 

m 


, 0 


I s 

r ,s 


r 

s 


are elemencs of «(V,W) . 


Then Che produce of cwo such censors is given by 

“S ■ I (“m • . 

“ms 

n,m 

r,8 


where Che symbol e is Che same as 9 ^ above. Nocice Chac Che mulclpli- 
caclon rule implies 


®-) ® 

nmrs nmzrs 

- (a^ « a) 9 (B 9 B) 

n rim s 

- (a a ) « (6„S^) . 

nr ms 

This relacion shows chac the algebra ®(V,W) is the canonical tensor pro- 
duct of the subalgebras ®V and ®W, or 

»(V,W) - (®V) ® (®W) . 


Our motivation is, of course, the expansion of functions f : X x U -r X, 
for X a real vector space of states and U a real vector space of con- 
trols. 


In concluding this section, which goes into considerable detail, we 
remark that there la more than one way in which to develop a tensor algehi.a. 
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A portion of Che difficulty in applications etudies is to det ^.irmine how 
to develop the sequence of censor vector spaces into an algebra. Various 
choices on multiplying censors may be made. The foregoing choice fits 
wall with preceding grant studies and is suitable for use in later sec- 
tions of this report. 


II. PROGRESS IN MODELING THEORV* 


2.1 INTRODUCTION 

The scudy of nonlinear syscema has become increasingly more acclve wlch 
efforts focused on overcoming the well known analytical difficulties that ac- 
company them. A vast collection of literature exists relative to this ac- 
tivity, particularly noticeable in the last 15 years. It is this body of 
literature, then, that this section considers, focusing primarily on the 
topics dealing in system approximation, bilinear systems, and algebraic 
structures. While these areas themselves represent a large body o.‘' the 
literature, only those papers deemed directly relevant to the present re- 
search aims are reported on here. 

By approximate systems we mean that branch of study which acce;u^ 1 ts to 
model complex nonlinear systems, such as 

X - f (x,u) , 

y - g(x,u) , (2.1.1) 

x(0) - x^. 

for X e u e R™, and y e R^, by simpler, workable forms which possess 
Che desirable properties of stability, causality, controllability, and so on. 
First order linearization schemes form a subset of this class of systems and, 
as we will point out, the problem has been well studied. Polynomic systems, 
which we also consider as representing a subclass of approximate systems, are 
equally Important and are thus reviewed here in the subsection to follow. 
Topics in analysis, crsated thoroughly in the classic works of Dieudonne [1] 
and Apostle [2], are crucial in all of these studies. 

*Contributed by Stephen Yurkovich. See Section 2.5 for references [A..], 
[B..], [C..]. 
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Bilinear systems may be considered as a specialization of (2.1.1) when we 
add the assumption of linearity in the control or in the state; that is, bi- 
linear systems are linear separately with respect to the state x and the 
control u, but not jointly. We characterize them by the following dynami- 
cal equation: 


m 

X ■ Ax + Bu + 'l N, u X , 
i-1 


( 2 . 1 . 2 ) 


y ■ Cx 

for the matrices A, B, and C of appropriate dimenjions (time invari- 

ant case), where u^ is the ith component of u. In a more concise form, 
the system (2.1.2) is illustrated in Figure 1. There are several practical 
and theoretical motivations for the study of such systems, as seen, for ex- 
ample , in [ 3 ] . 


Algebraic system theory is the main vehicle toward the goals of the pre- 
sent research. The works of Wonham [4] and Sain (5) in the area of multivar- 
iable systems offer a necessary springboard for studies in this field. In 
[7.8,9,10] the motivations put forth in [6] are extended toward real modeling 
problems, utilizing the symmetric censor algebra. Unfortunately, Che liter- 
ature is rather sparse on this topic relative to nonlinear system theory. 
However, the papers we will cite in the area of algebraic censors are ex- 
amples of the uses of similar ideas in the literature. The intent is not to 
expound the details of the theory; this may be found in such works as [11] 
and [12]. Similarly, Che theory of Lie algebras apparently plays a perti- 
nent role in the research. Several leading works will be cited, while a 
more complete exposition of the theory is given in [13] and [14]. 
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2.2 APPROXIMATE SYSTEMS 


We begin chls subsecclon by discussing an imporcant linearizacion techni- 
que which a handful of authors have utilized in recent yearr. It will be seen 
to be useful not only in linearization of nonlinear systems but in bilineariza- 
tions as well. This approach appears to have been Introduced first by Carleman 
[Al] in 1932. 

Let us initially consider the following scalar nonlinear differential 
equation , 

X - f(x) , (2.2.1) 

where f(x) may be required to have certain analytic properties. The 
Carleman Linearization Process (CLP) is based on the fact that any homogeneous 
nonlinear differential equation (2.2.1) can be converted into a linear dif- 
ferencial equation of infinite order by defining new variables 

- x*" . (2.2.2) 

Ry cutting off this infinite system at a finite stage a closed set of equa- 
tions which model (2.2.1) may be obtained. 

One of the earliest (1963) applications of this linearization approach 
appears in [A2], where the basic idea is Co employ the CLP in rewriting non- 
linear equations as an infinite sequence of coupled linear equations. This 
sequence is then truncated by a linear closure approximation involving a 
mean-square error minimization. The multidimensional case is treated in the 
following manner. Consider the set of nonlinear differential equations 





‘ij 


N 

I 

J.k- 


ijk '‘k 
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x^( 0 ) - c 


(2.2.3) 


Taking x x. aa new variables y ■ using vector notation, 

j ^ ^ J ^ 


(2.2.3) becomes 


X • Ax + By , 


y - + p(x) , 


(2.2.4) 


where x is an n-vector so that y and f (x) are of dimension n , A is 

2 2 3 

nxn. A, is n x n , and B is 2n x n. Similarly, we can form the n 

X system satisfied by functions x^x^Xj^. While the notion of tensor 

products involvins; x or y (to form the monomial terms) is not used, it 


is pointed out that the A^ are the Iterated Kronecker sums (denoted by 
®.) of A, 


A^ - A A , 

A 3 • A A,, 

- A A A . (2.2.5) 


.md so on. (A discission of the Kronecker sum may be found in Ueliman [131; 
this and the Kronecker product are major topics in 2.4 of this review.) 
Stability of (2.2.4) is related to the characteristic values of A. 


Alternate linearizations are also considered in [a 2] in which any 
continuous function ( 2 . 2 . 1 ) (not necessarily analytic) can be expanded in 
an orthogonal series. For example, assuming chat x varies only over 
-1 ^ X ^ 1, Legendre polynomials offer the best linear approximation in 
Che mean square sense. A similar statement can be made for Chebychev 
polvnomlals. 

A form of Che CLP is used in [A7] in estimating the "domain of attrac- 
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cion" (scablllcv rt>sulcs) for a class of nonlinear systems. A scacem«.*nc of 



the CLP is presented with a detailed proof in which an algorithm is developed 
for an Iterative procedure for estimating the domain of attraction. The 
theorem involves an error bound in terms of Euclidean norms. 

The work of Sira-Ramirez in [A9,A10] follows the work in [A7], particu- 
larly in [AlO] where the main theorem used by Loparo, et.al., forms the 
basis of the paper. In [AlO], the use of the CLP is proposed for feasible 
sec (sec of all possible solutions of the systems of differencial equations) 
computation on a class of nonlinear analytic feedback systems. The error- 
bound result of [A7] is used, then, to approximate arbitrarily close the 
feasible region of a nonlinear system (whose initial state is bounded by a 
compact generalized polyhedron). Moreover, Che higher dimensional linear 
system obtained from the CLP has parameters which are shown Co be comput- 
abLe in terms of the Volterra series expansions of the nonlinear map. 


Let us now introduce some not.it ion whioh Is generally .iccepted and 

tvplcallv attributed to Rrocketc (see [B2] and fC12]) for use of the CLP. 

Civen Che n-vector x with components x, , denote by x^^^ the ^ 1 

i P 

dimensional vector with elements of the form 

n P 

1 Tf X , (2.2 

i-1 

n 

wicli ' P. “ P. P . 0, and a constant scalar. For example, we 

i-1 

can represent typical terms a.s 


x^^J - X , 


^ 2 ^ 2 ' • 


(2.2.7) 
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and so on. where ' denotes transposition. The elements of are ordered 

lexicographically^, in the manner (2 2.7), which becomes important when any 
actual calculations are done. In [9] Is given a general algorithm which ac- 
complishes this for use on a digital computer. There it is pointed out that 
such objects (2.2.7) are actually elements of a tensor product between p 
vectors . 

With this notation defined, we consider now the results of Krener in [A5] 
and a specific class of nonlinear control systems. We restrict ourselves 
here to the case of scalar u, entering linearly, yielding the differential 
system 

X ■ f (x) + uf , (x) 
o I 

y - gg(x) + ugj^(x) 

|uj <_ 1, x(0) - n . (2.2.8) 

With the assumption chat and are as smooch as needed, (2.2.8) in 

general gives rise to an infinite dimensional bilinear system of Che form 

1-p-l ^ ^ 

(V 

y - [ C x^^^ + u D x^^^ , (2.2.9) 

i-0 

for matrices A^, , C^, and of appropriate dimensions. Now (2.2.9) 

may be truncated by setting x^*^^ ■ 0 for p ^ q, and by defining a new 


There has appeared in Che literature at least three different words for this 
same connotation: lexicographically, lexigraphically , and lexographically . 

Interestingly enough, Che third of these apparently is not an accepted word 
(according to Merriam-Webster) but is seen most eften, probably due to its use 
by Brockecc [B2]. We will adopt the first of these, lexicographically, an ac- 
cepted term from formal language theory. 
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scace veccor as 


X 




.X 


[,- 11 ,, , 


Che resiilc Is a flnlce dimensional bilinear ayscem 

X - Ax + uBx 


y ■ Cx uDx 

|u| < 1, x(0) - (1.0 0) . 


( 2 . 2 . 10 ) 


( 2 . 2 . 11 ) 


We scace now che main Cheorem for blllnearlzaclon abouc a polnc. 

Theorem [A5J Consider che nonlinear concrol syscem (2.2.8). 
For any Inceger t ^ 0 chere exlscs a bilinear concrol 
syscem (2.2.11) such chac for some conscanCs M, T > 0 
for any admlssable Inpucs the oucpucs y(c) and y(c) 
of che nonlinear and bilinear syscem, respeccively , saclsfy 

|y (c) - y (c) I £ Me*’ 

for all c e [O.T]. Also, If x is che scace of (2.2.8) 

and X consists of x, to x of che state of (2.2.11), 

.u In 

Chen 

|x(c) - x(c)| £ 
for all t K [O.T] . 


An equivalent result is proved for blllnearlzaclon abouc a reference trajec- 
tory. 


An earlier work by Krener, [A4], studies the problem of when two concrol 
systems (where the concrol enters 4inearly) are equivalent, i.e., that there 
exist a local dif f eomorphisra which cakes che solution of one system for each 
concrol into che solution of che other for che same concrol. Necessary and 
sufficient conditions are derived. As a corollary, necessary and sufficient 
conditions are derived for a nonlinear system to be locally dif feomorphic to 
a linear syscem. These equivalence and linearization results hinge on the 
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cheorien of manifolds and Lie brackets. 


A method of formal linearization is presented in [All] in which the state 
of a nonlinear system is au mented with linearly independent functions (lif's^ 
of the state variables. The result is a system, where the dynamical equation 
of the augmented state la expanded in a series of life, which is lit ar in 
the function space spanned by the lif's. This of course amounts to a form of 
the CLP and, in fact, a result using Taylor's Theorem (with remainder term) 
is given. Moreover, a numerical example is reported on. 

In [A13] Crouch offers a rigorous development in which he considers non- 
linear systems described by finite Volterra series, with certain analyticity 
and linear- in-the-control requirements. The natural properties of Lie algebra 
of Che system lead to the formulation of the state space as a homogeneous 
space of nllpotent Lie groups. This leads to showing that the state space 
is homeomorphic to a Cartesian space. Thus, when these systems are set in 
n.icurnl cnordin.ito systems it (s soon th.it the st.ite sp.icc adiaits a nacur.al 
vector space structure. A finer structure is also identified which shows 
that these systems are cascades of linear systems with polynomial link maps. 

Further results dealing with Volterra series e.\pansions are discussed 
in [Abl. There, a general methodology is developed for obtaining fundamental 
expansions consisting of multilinear integral operators. Validity conditions 
for Che expansions are obtained, as are results concerning the approximation 
errors for appropriately defined normed spaces. Several such error bounds 
have been mentioned thus far, and are crucial in any approximate system re- 
sults. Another method, which defines a dynamical error system, is described 
in [A3]. 


As a lead-in co the discussion of polynomic systems, w« point out two 
papers by Porter. In [A8] polynomial operators (one example is a usual 
Volterra series) are used in the approximation of nonlinear systems. The 
classic Weierscrass result is used in which the function to be approximated 
need not be differentiable: rather, emphasis 1s placed on approximating the 
function by polynomials over a compact set. The Bernstein system (employing 
Bernstein polynomials) is one constructive realization of the Weierscrass 
approach. A comparison is given for this methodology versus power series ex- 
pansions. In (A12), Porter utilizes a Hilbert space setting and considers 
two distinct problems, interpolating and approximating (for a "black box" 
phenomenon). The basic theorem here shows that interpolators which can be 
realized linearly on a vectorized space have a specific approximation pro- 
perty . 

A rather complete overview of the che>r*> of polynomic systems is given 
by Porter (1976) in [A14], containing 75 references on the topic. In this 
framework, a function Is said to be polynomic if it is a finite sum of multi- 
power maps (defined also in [A15]) and said to be analytic if it is an in- 
finite sum of mulcipower maps with an appropriate convergence. Thus, poly- 
nomic operators are a subset of analytic operators. In [A15] it is shown 
chat a W»‘‘ ■'rstrass-type approximation result does not hold between the 
finite memoryless polynomic function.s and Che memory less continuous function. 

A symmetric multilinear operator W from to H (where H is a Hilbert 

space) is said co generate a multipower function W : H - H by the rule 

W(x) ■ W[x,x x) . (2.2.12) 

For causality studies, orthoprojectors are introduced. 


Th« problem crteced In (A18) can be conacrucced ee an idencificacion 
problem, che repreaencaclon of a black box phenomenon by polynomlc or multi- 
linear modela. From a collection of observed input-output pairs a polynomic 
operator is constructed. 

Conditions are derived in [Alb] which guarantee that a feedback system 
modeled by a "general quadratic and cubic" plant and controller will be of 
the type 

X • Ax + kBx Du + N(x,x) + M(x,x,x) 

y ■ Cx , (2.2.13) 

for vectors x, u, and y and the feedback factor k e R, where N is a 
bilinear form in x and M is a trlllnear form in x. These systems do 
not. however, contain forms which are trlllnear In x^ and mixed. 

The concept of span reachability is considered in [A17] where discrete 
polynomial state-affine systems are treated. The class of systems studied 
.ire said to be sp.an- reachable if the set or state vectors which are reachable 
from the origin span che entire state space. 

The use of censor products has recently emerged in che literature rela- 
tive to polynomlc system theory. For example, in [A19] a multivalued 
switching function f is said to he realized by "polylogic" (over an index 
set) if there exists a polynomlc function which computes f (on che domain 
of f). The implication Is chat a polynomlc realization j (x) of a given 
switching function f : a" -<• A exists if and only if a linear realization 
exists , 

f (x) - (I (x) ■ Tx (2.2. 14) 
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{x}, J - 1 


n . 


(2.2.15) 


for X ? a”, wh«r« 


To lLluscrac«» if che index sec is (0 , 1 ,2 , 3 } (n«4) , Chen 

X" (1, x, x®x®x) 

since X is defined co be 1. Compucecion of such I nd 
o 

is discussed. 


(2.2.16) 
in (2.2.14) 


A fur Cher example of che use of censor produces is given in [A20] where 
che copic is scace represencacions of polynomic maps. Briefly, if H is a 
Hilberc space Chen for x c H, che quadraclc operacor 

y(x) - (1, X, X © x) (2.2.17) 

Id defined in order co creace che new Hilberc space 

H ■ closed span (yCx) : x e H} (2.2.18) 

wich inner produce induced by chac of H. Moreover, H is shown Co be a 
Hilberc resoluclon space. Wich this, causallcy properties of non-epic poly- 
nomic maps such as Y : H -► H are discussed, and Che creacmenc of higher 
order polynomic operacors is alluded co. These concepts are then employed 
for state decompositions. 


20 


2.3 BILINEAR SYSTEMS 


A brief introduction to bilinear systems was given in Section 2.1 where 
(2.1.2) and Figure 1 served to depict such systems in mathematical and block 
diagram forms. The importance of bilinear systems to the present research 
is evident by the fact that any bilinear function may be represented in terms 
of the universal tensor product function. In fact, bilinear (or "2-linear") 
functions are merely a subset of the class of multilinear (or r-linear) func- 
tions which in turn, with appropriate operations defined, can be identified 
up to an isomorphism with a space of algebraic tensors. Furthermore, inner 
product spaces have inherent relations to such ideas since over the real num- 
bers any inner product is a bilinear form. So the area of bilinear system 
tbeoty, while in itself a large and growing field, contributes in many ways to 
ongoing research in multilinear (and thus nonlinear) dynamical systems. 

An introduction to bilinear systems and the accompanying body of liter- 
ature can be found in the survey papers [B5] and [B6] in 1974, and [B17] in 
1980. Bruni, Diplllo, and Koch in [B5] (an often cited work) outline some 
basic definitions of bilinear systems. To summarize, let us rewrite (2.1.2) 
here for convenience, in a slightly different form: 

X ■ A(t)x + B(t)u + N(t)xu 

y - C(t)x (2.3.1) 

where the input u is assumed a priori to be of a specific class. The ma- 
trix A(t) belongs to r'*™, 3(t) to r'"‘ and N(c) is a bilinear form 
in X and u which can be rewritten in the manner 

N(t) xu ■ ^ N. (t) XU. , (2.3.2). 

i-1 

for N^(c) in This definition (2.3.1) of a time varying bilinear 
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system (time Invariant if A, B. C, iind N are not time dependent) can be 
further specialized under additional liypothesis. Bilinear systems are de- 
fined to be homogeneous In the state if B ■ 0, homogeneous In the Inpu t if 
A - 0. and strictly bilinear if A - B - 0. Along with these and further 
definitions, the authors stress the fact that there have been no effective 
contributions to the application of bilinear system theory to the solution of 
practical modeling problems . While there has been some recent contributions, 
the general identification problem remains unsolved today, and only a few re- 
sults for the special cases seem to be available. The topics of stability 
and distributed parameter systems are also listed as trends for future re- 
search. 

In 1974 Mohler [B6] pi'olished another such survey-type paper in which 
he discusses the evolution of bilinear systemfi, with emphasis on their ap- 
plication to population models, biological svstems, nuclear fission processes, 
and socioeconomics. It is pointed out that in these various Instances bi- 
linear mathematical models arise in a natural manner, while in others they 
represent another degree of approximation beyond that of linear models. 

This paper may be overshadowed now by a more recent work (1980) by Mohler 
and Kolodziez [B17]. Here, feedback combinations of bilinear systems are 
discussed, and the following point is made. In many systems feedback com- 
binations result in multilinear models which may be decomposed into open 
loop bilinear svstems for certain analyaes. In this manner multilinear mod- 
els and bilinear systems may be used to approximate more highly nonlinear 
svstems. An anproximatlon theorem due to H.J. Sussman is quoted where it 
is stated chat arbitrary functions satisfying certain causality and con- 


tinuicy conditions can Le approximated arbitrarily close by maps which arise 
from bilinear systems for measurable and bounded Inputs. The authors note, 
however, that this does not give a method for constructing the approximate 
bilinear system for a given nonlinear system and that the basic assumptions 
may In fact be too restrictive. 

Possibly the most often cited paper in the bilinear system literature 
is [B2]. Brockett considers the algebraic structure of bilinear systems and 
sketches the general procedures for constructing a theory parallel to that in 
linear systems for parallel and series interconnections, canonical forms, 
controllability, observability, and equivalent realizations. The starting 
point uses the fact that (see also [Cll]) any input-output map which can be 
realized by 

m m 

x(t) - (A + I u (t) B ] x(t) + [ I u (t) b ] 
i-1 ^ ^ i-1 ^ ^ 

y(t) - Cx(t) , (2.3.3) 

lor appropriate matrices A, 3^ and C and vectors b^, can be realized by 

m 

z(c) - [F + I u (t) G ] z(t) 
i-1 ^ 

y(t) - H z(t) . (2.3.4) 

A more involved result says that any input-output map realized by 

m 

x(t) - [A + I u (t) B ] x(t) 
i-1 

q 

y(t) - I -i; (x(t). x(t) , . . . ,x('-)) , (2.3.5) 

P“1 ^ 

where is a p-linear map in .x(t), can also be realized by the form 
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(2. 3. A). One such construction uses a form of the Carleman linearization pro- 
cess. These results rest on the fact that if x satisfies a homogeneous in 

the state biline.ar system, then so does x^™^ (the lexicographically ordered 

(21 

vector defined in the preceding section). That is, if z is given by x , 

12 ] [ 2 ] 

then there exist matrices A and such that 

i(t) - -t- I u,(t) Bph z(t) . (2.3.6) 

i-1 . ^ 

At this point Brockett alludes to the use of Kronecker product relation- 
ships (for iterative construction of the and B^^^) and the theory 

of symmetric tensors, citing reference [13]; again, however, tensors are not 
used in the development. 

.Several other general points of interest are made in [B2|. With re- 
spect to inr 2 rconnections , if the parallel connection of two bilinear reali- 
zations is defined, the resulting system will have a bilinear realization. 

The same is not true for series connections; that is, bilinear systems are 
not closed under series connections. However, if the series connection of 
a system having a bilinear realization followed by a system having a linear 
realization is defined, then the resulting system has a bilinear realiza- 
tion. As a final point, Brockett notes that in classifying systems and in 
determining equivalent realizations, the results available in the study of 
Lie algebras are of fundamental importance. 

A global hil Inearization result is given by Lo in [B12], summarized 
in the following. Consider the nonlinear differential system 

x(t) - f(x) + [C(x)l u 

z(t) - h(x) -*• [Q(x)l V , (2.3.7) 
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for X e r”, z e iR*^, u e (r"*, and v e IR^. The nonlinear system (2.3.7) is 

dynamically equivalent to the bilinear system 

m 

y - (A + I B. u ) y(t) 
i-1 


z(t) - (C + f D, V ) y(t) (2.3.8) 

1-1 

for some M > 0, i - 0,1 such that 

M -1 M -1 , 

rank (C\ A'C (A') C'., D^. A'li' (A') 1 ’ 

M -1 

...D' A'D' (A-) P D'l 

P P P 

- dim A (2.3.9) 

if and only if (2.3.7) has a finite-dimensional sensor orbit. Briefly, if 

00 

L(g(x)') - g^(x)f(x) where Is the gradient of g, and if h c C , 

the sec of functions 


where 
(2.3.7) ,ic 
a method of 
by letting 


{h(x), L(h(x)), L^(h(x)) , . . . } 

U tU^.i LQ^(x), L"Q^(x) , . . . }] , 

denotes tl\e l-Ch ;olumn of Q, i.s called the 

time c for any Input. In a final note, Lo 

constructing (2.3.8), attributed to Brockett 
y . ,Imax(k,p)l,, 


(2.3.10) 

sensor orbit of 
points out chat 
[B2], is achieved 


Stochastic bilinear systems are treated in [B7] in which systems with 
multiplicative noise processes (thus, bilinear) are considered. Brockett's 
"moment equations" ([C13]) are used to compute Che expected value of x^P^ 
for zero mean white noise Gaussian processes. The condition that E{x^P^} 
have a closed form solution is that the Lie algebra be solvable (see [14]). 
If the Lie algebra is not solvable, an approximation method is used by 
truncation of cumulants (coefficients of the Taylor Series expansion of 
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Che logarithm of Che characteristic function). 


In [B16] Che optimal control of a class of single-input discrete bilinear 
systems is considered. Through dynamic programming solutions are obtained 
for Che deterministic and stochastic problem, where the performance index is 
the usual quadratic cw^c function in discrete time. 


Controllability of bilinear systems has been treated by many authors 
during the 1970's. One of the original works (1968) on the subject is chat 
of Rink and Mohler [Bl]. There, two sufficient conditions are given for a 
bilinear system such as (2.3.1) to be completely controllable. Several ex- 
amples are given, and in an appendix the set of equilibrium points for bi- 
linear systems is described. This work is extended in [B13] where the solu- 
tion of the parameterized equation 

m 


X • [A(t) + I B (c) V ] x(c) + N(C) u(c) , 
i-1 ^ 

with x(c ) * X and v an element of a Banach soace of continuous 
o o 

valued functions on a finite interval, is given by 

rt 


x(c)-f(c, c;v)x + 
o o 


l(C, s; v) N(s) u(.s) ds . 


c 


(2.3.11) 


IR 


m 


(2.3.12) 


o 

Here, ■«>(c, t ; v) is Che state transition matrix associated with Che matrix 
o 

which premulciplies x(c) in (2.3.11). From this, then, a nonnegative sym- 
metric controllability matrix is defined which is used to obtain global and 
totally controllable results by bounding ■l'(c, t^; v) . 


In [B3] is given a description of the "least linear subspace" that con- 
tains all the states of the system (2.3.1) (for scalar u) reachable from 
the origin. For this purpose a canonical decomposition of the state space 
into a direct sum of four subspaces is considered. Sufficient conditions 
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for Che reachable sat of a bilinear system at a fixed time to be convex are 
given In [B9]. Under the hypothesis for reachability (convexity), the mini- 
mum time control for transferring x^ to any ocher reachable point is dis- 
cussed under the guise of bang-bang control. A rigorous treatment of reach- 
ability (and observability) concepts is found in [B14]. This paper shows chat 
any two "quasi-reachable" and observable realizations of bilinear systems are 
isomorphic. This leads to the construction of canonical forms utilizing the 
Kronecker product of matrices. 

As mentioned previously, Lie algebras play a vital role in bilinear 
system theory, particularly in the study of controllability. In fact, in 
the opinion of Elliot [B8] in 1974, the most important criterion for con- 
trollability and accessability of a homogeneous (in Che state) bilinear sys- 
tem is Che transitivity of the associated Lie algebra. We briefly state 
such a controllability (necessary) condition concerning the bilinear system 

X - (A + uB) X . (2.3.13) 

Let L be the .smallest real linear subspace of matrices A and B closed 
under the Lie product, and let {Cj^,...,c^} be a basis for this Lie algebra 
L. If system (2.3.13) is controllable Chen L is transitive (see below 
also) , chat is , 

r.ink (c,x,...,c x) • n (2.3.14) 

i m 

for ail X £ p" - r" - (O' Since the origin is an isolated equilibrium 
point for a bilinear system such as (2.3.13), is the usual scatt s^'ace 

considered . 

The work of Cheng, Tarn, and Elliot [BIO] offers a brief survey of 
works concerning controllability of bilinear systems. Moreover, a discus- 
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glou of Lie algebras and Lie subalgebraa Is given. A definition of cranai* 

Clvlty Is given, stated In the following. Ve say that a set M of matrices 

la transitive on r” If for everv x, y e r” there exists an X in M 

0 o 

such that Xx • y. In this paper both discrete and continuous time control- 
lability is discussed. 

Observability is considered in [B18] for homogeneous in the state bi- 
linear systems. It is noted that an observable (in the usual sense) bilinear 
system may be unobservable for some inputs. The primary concern, then, is 
the design of inputs u^* which are as close to the given input u (in the 
L 2 sense) as required so that the bilinear system will be observable rela- 
tive to u*: an algorithm for choosing such inputs is developed. Other 

methods for achieving this are discussed, such as optimization of observa- 
bility matrix eigenvalues. Here, however, appropriate inputs are achieved 
by slightly perturbing given inputs. 

Tclentl firnci'in of btllnenr systems Is discussed in f ] . A dutermlniscic 
approach using Newton's method is employed, then statistical hypotheses are 
allowed and Maximum Likelihood Estimation is carried out forming a differen- 
cial bilinear model. Similar aims are pursued in [Bll] where Isidori and 
Ruberti consider time varying bilinear systems such as (2.3.1) in finding 
internal descriptions. The state transition matrix associated with x ■ 

A(c)x is used to express the response in terms of Volcerra kernels. This 
leads CO necessary and sufficient conditions for realizability by a finite 
dimensional bilinear internal description. This paper follows closely along 
the lines of [B22]. In [B15] is given necessary and sufficient conditions 
for Che existence of a nonsingular matrix with real entries which transforms 
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Che given mulct- input , mulct-oucpuc bilinear system into a triangular can- 
onical form, which amounts to a coordinate transformation within the state 
space. Conditions on the internal description are outlined, and on the ex- 
ternal description (external data) conditions are specified via a realizable 
formal power series. 

The review of the literature for bilinear systems up to this point sug- 
gests an adequate foundation on which Che study of i. ealizacion theory can be 
undertaken. A detailed discussion of this broad topic and numerous theories 
involved is of course beyond the scope of this review. However, because of 
its overall Importance, several papers on the subject of bilinear system 
realization are listed and will be briefly discussed. 

An early (1969) work by Arbib [B19], following the work of Kalman, ob- 
tains a decomposition for multilinear discrete-time constant systems in 
terms of linear subsystems and multipliers. For instance, it is shown chat 
a bilinear system may he ch.nraccorized by two layers of linear systems. 

While most of the paper concerns automaton minimization, an appendix in- 
cludes a summary of the theory and use of the censor product to achieve some 
of the results for bilinear systems concerning the construction of canonical 
forms. This decomposition idea is further developed in [B20] where explicit 
conditions for minimal realizations of time-varying multilinear maps are 
obtained. The Nerode realization theory is applied with algebraic concepts 
such as quotient spaces. Again, as suggested in (B19], the bilinear map ® 
is used in the canonical factorizations Another work concerning multilinear 
maps and their realizations is [B29] which further extends these ideas, 
studying also observability and quasi-reachability of the multilinear systems. 
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Similar are discussed in [B27] by Che same auchor, wich Denham, for 

bilinear syscems. 

In [B26] a technique for bilfnear system idencificaclon is developed 
which uses a finite orchonormal expansion to Approximate Input-output func- 
tions. The basis of the expansion is Walsh functions which form a complete 
orchonormal set. Two useful properties of Walsh functions are that wich the 
proper multiplication defined they form a commutative group and that the in- 
tegral of a Walsh function can be represented in terms of Walsh functions. 
The technique is Illustrated with four computational examples. 

Tarn and Nonoyama [B24] obtain algorithms for the construction of dis- 
crete-time internally bilinear state space models. The notions of the cen- 
sor product and the less known affine tensor product are used to describe 
such syscems. 

Minimal realizations are studied in [B21] by introducing a "generalized 
"ankei mutrix", anaiogeoua to linear system theory, formed from input-output 
m.ip parameters. Ir, [B22] the realization theory for bilinear systems is de- 
veloped in terms of Volterra series expansions of the zero state response, 
while [B25] uses functional series expansions, building on previously cited 
works. 

Based on the theorem for global bilinearization given by Lo (as dis- 
cussed in [B121) in [B28] is developed an approximation theorem of linear- 
in-the-control bilinear systems. Use of Taylor's Theorem is discussed and 
construction for the bilinear approximations is given in the proof of the 
theorem. In [B23] Krener developes a result similar to that of [A5], where 
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again Ic is shown that every nonlinear realization can be approximated by 
bilinear realization with an error that grows like an arbitrary power of 


In [B23], however, 
ment somewhat more 


Lie algebraic concepts are employed, making the develop 
rigorous than that of (A5). 


2 . 4 ALGEBRAIC STRUCTURES 


Several references have already been deed for a general incroduccion co 
Che algebraic topics with which che current research is concerned. Since Che 
work of [7-10] hinges primarily on che usage of algebraic censors and spaces 
of multilinear functions, our main emphasis here is on chac of che censor al- 
gebra. While [11] and [12] offer a formal creacn.enc for Che necessary back- 
ground, we mention several works in che literature to add co these sources. 

We begin with cwo cucorial-cype introductory papers on these topics. 

In [C2] che theory of multilinear forms is reviewed and che main discussion 
centers on che notion of che linear operator contraction. A technical dif- 
ference between che contraction of censors (which exists independent of its 
expression In particular bases) and che contraction of multilinear forms 
(which in gener.al is basis dependent) is outlined. Beginning with vector 
spaces and their duals, several types of contractions ato discussed and are 
shown co coincide with che "usual" engineering definition of contractirn. 

The second tutorial paper, [C3], discusses the properties of bilinear forms 
(or "second-order censors"). For V an F-vector space (F a field), che set 

of all bilinear forms on V x V can be constituted as a linear vector space 

2 

itself with dimension equal to (dim V)“ by che definitions 

+ a^) ( • ) - 3j^( • ) + a, ( • ) 

(kSj^) ( • ) - k3j^( • ) , (2.4.1) 

where a^^ and a., are arbitrary bilinear forms on V x V, k e F. Many 
other elementary topics are introduced and extended, including a discussion 
of che inner product as a real positive definite symmetric bilinear form 
a : V X V - R. 
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W« have already wicncssed varloui usea of ch« Kronackcr produce and of 

Kronecker suma of macrlcea (or, abacraccly, linear cranaformaciona) in' Che 

licaracurc. The Kronecker produce la of course Icself a cenaor produce. 

Bellman ([IS], Chapeer 12) has supplied a aolld foundaelon for ehe proper elea 

of ehe Kronecker produce, and haa shown [A2] how chey may be employed In ehe 

Carleman ] Incarlzacion process. The uclllcy of ehe concepe for compucaclonal 

aapeecs has also been explored for use In such copies an aoluclon of linear 

2 

equaclons and algorlchms for Fasc Fourier cranaforma . Because of les ver> 
saclllcy, Chen, we will discuss some works concerning Che usefulness of ehe 
Kronecker produce which relace Co ehe copies e.xplored chus far. 


Brewer [C6]'^ gives a general overview of ch<. algebra relaced Co che 
Kronecker produce, surveying che liceracure and quocing many u.seful cheorems, 
definitions and propercies. Furchermore, the calculus of matrix valued 
functions is reviewed. The main emphasis of che paper is che development of 
a parameter idenclflcacion meched, based on Newton Raphson Iteration, for 
linear time Invariant syscems using che matrix calculus and che Kronecker 
algebra. In an earlier work (1973) of Barnett [Cl] matrix calculus ideas 
are explored and a solution to che matrix differencial equation 

+ a^Ky^’^'^-' + ... + a^K^^y - 0 (2.4.2) 

is developed. The interesting point here la chat y is a vector given by 


stacking che rows of an m x n matrix X ■ denoted by 

Vr(X) . ..x^J’ 


(2.4.3) 


“We mention this application for che interested reader, particularly in ref- 
erence to a paper by H. Sloate in IEEE Trans. Clr. Sys . . Jan. 1974, p. 109. 

3 ' 

Brewer adds corrections to this paper che following year, IEEE Trans. Cir. 

Svs. . ^fay 1979 , p. 360. 
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and K-AA,B-A®I + I AB' is ch« Kronccktr sum of some mecrices A 
K n m 

and B. Results Involving v^ are given, such as 

v^(CXD') - (COD) v^(X), (2.4,4) 

for Che p X m matrix C and Che q x n matrix D. The Kronecker product 
does not in general commute, but it Is shown that, for C and D as defined 
above , 

DOC ■ P(C ® D)Q (2.4.5) 

where P (depends only on p and q) and Q (depends only on m and n) 
are permutation matrices. 

Similar results have been derived by Kuo [C4], where it is shown Chat 
Che nonhomogeneous product system 

(Aj^®A2)y"bj^®b^ (2.4.6) 

is solvable if and only if 

Aj^Xj^ - bj^ and A^x,- b, , (2.4.7) 

for some x^^ and x^. And, in fact, if y is a solution to (2.4.6), then 
y - Xj^ 0 X.,. This result is used in accordance with the column stacking op- 
eration (analogous to chat for rows i.n (2.4.3)) to develope censor factor 
e quations (2.4.7) for a system such as (2.4.4). in [C7] the notion of the 
"extended" Kronecker product and its accompanying properties is given, de- 
noted by 

A O B - (A, ® B, 1 . . . i'a ® B ) , (2.4.8) 

i. i r r 

where A ■ (A^',..'a^) and B - (Bj^j..,jB^) are two partitioned real ma- 
trices (in [C6] a similar notion is described and called Che "Khacri-Rao" 
product). Results similar to those found in fC4] are given involving the 
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produce (2.4.8). The use of censor products In linear progranuning is also 
discussed . 

Another use of these ideas is given in [CIO] where state transition ma- 
trices are utilized. Consider the system 

X(t) - Aj^(t)X(t) + X(t)A2(c) . (2.4.9) 

This can be rewritten in the form (2.4.2), 

^ (v^(X)l - A(t)v^(X) . (2.4.10) 

where A(t) ■ A^^ with state transition matrix ♦^^(t.t^) ® 

for the state transition matrix* associated with A^. It should be noted 

4 

Chat in a follow-up comment on this paper, Barnett presents an alternate 
derivation for this result. 

As an in.trodt’ :tion to a segment of the literature involving computa- 
tional aspects of tensor products, we cite [C9]. This numerical work de- 
scribes the censor factorization algorithm for tensor spline^ approximation 
and how it applies Co least-squares fitting. Also used is Che singular 
value decomposition and matrix condition number. Here, "tensor" again re- 
fers to Che Kronecker product of matrices. 

A technique for identification of nonlinear systems using censor ideas 
is developed in [C5]. Systems which admit a finite Volterra series repre- 
sentation are considered, where each multidimensional system transform is a 
product of single variable transforms. It is shown that this type of system 

4 

IEEE Trans. Autom. Contr. , April 1981. p. 603. 

^A spline function is one which approximates a, say, continuous and differ- 
entiable function on an interval in a piecewise fashion using low degree 
interpolating polynomials. 


35 


can be modeled, from an InpuC-outpuc point of view, as a cascade of a linear 
system, a homogeneous nonlinearity, and another linear system, as shown in 
Figure 2. 


u 



Figure 2. Input-Output Model. 


A (minimal) realization of the system in Figure 2 is given by 

it ■ Ax + 3u , a ■ Cx 

z - i d: ^ 

i-1 


V ■ Lv + Mz , y ■ Nv. (2.4.11) 

Ste.ulv '^tato s iniiso I d.i 1 nnnlysLs is used in the identi f i c.ic ion . As an al- 
ternative to an association of variables method, techniques are used to 
identify the system transforms leading to a response analysis (where the 
input consists of a finite sum of sinusoids and/or exponentials) based on 

tensored transfer functions. In short, for H (s) = H(s)u(s), we have 

a 

y(s) - [ I D!h[^^s)] G(s) , (2.4.12) 

j-1 - 

f k] 

so that tile kev is to compute the tensored transfer function H (s), 

a 

r k] r k 1 

given H (s). It is important to note that F^ (s) ^ (F(s)) for a 

d 

transfer function F(s). The authors point out the fact that because of 
the recursive nature of the approach, the practical question of error 
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propagaclon Is under Invescigucion. 


In [C8] Burlc creacs che problem of optimal state feedback regulation of 
polvncniai nonlinear systems . Tensor algebraic operators are the main vehicle 
Cowards this end, and che symmetric censor algebra forms che foundation for 
Che development. Both time-varying and time invariant systems are treated 
over finite and infinite regulation intervals. 

The final body of literature to be considered in this section Geometry 

and Lie aglebra represents rich mathematical notions which contribute to a 

wealth of useful cunrepts. A thorough understanding of che ideas developed 
in these papers would contribute immensely to the understanding of all pre- 
vious citations in ch.’s review and their Importance cannot be overemphasized. 
Due Co cheir complex and rigorous nature, we shall move quickly through most 
of che discussion and outline only the general concepts encountered. 

We begin by centering our attention on che work of Brockecc in these 

■Ileus, citing seven papers from 1972 through 1976. Five of these seven form 

a foundation on which much of che literature builds; two others, [C15] and 

[C17], represent significant contributions in general nonlinear and linear 

systems theory, respectively. In [Cll] the system 

m 

•X(C) - (A + I u. (t)B.) X(t) (2.4.13) 

i-1 ^ ^ 

y(t) » i!)X(t) 

is studied, under che hypothesis that X belongs to a matrix group and 
where A and B^ belong to the Lie aglebra associated with .1. The nota- 
tion i(iX(t) is to be interpreted as being a coseC in for che matrix 

I 

This paper summarizes the authors Ph.D thesis at che University of Minne- 
sota, 1978. 
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group Ip. The primary Inceresc In che class of sysCems (2.4.13) is control- 
lability in so far as it contributes to a framework for studying other system 
theoretic questions such as observability and realization theory. In this 
way, the objective is to reduce all questions about the system to questions 
about Lie algebras and group manifolds. 


The study of Lie aglebras in control theory was motivated mainly by the 
confrontation of some physical problems which proved linear system theory to 
be inadequate, and by work on Lie algebraic methods in differential equations. 
This latter topic is treated in [C12] where the expression 




(2.4.14) 


arises naturally for smooth functions f and g from to r". The 

quantity (2.4.14), usually written as [f,g], is called the Lie Bracket 
of f and g. An extension of the Carleman linearization process is de- 
scribed, summarized in the following. If N •• (^ "*" ^ ^) and x e r'^, 

P 

Llicii, as discussed previously, associated with each map from IK*' to r'' 

N N 

is a sequence of maps, the p-th one mapping R into R . a convenient 
basis choice contains elements (2.2.6), or 


/ 


(P )(P‘Pi) ... (P"Pr 


...-P Pi P2 

p P-^^ ^2 


(2.4.15) 


with p » p, p > 0. The constants multiplying the monomials in (2.4.15) 

i-1 

are chosen such chat 

for l|x| I ■ (<x,x>) 
generally , 


.[P] 


1 /: 


(2.4.16) 


where <•»•> is Che standard inner product. More 
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(2.4.17) 


Finally, denote by 


<x,y> 



y 


the map 
« Ax ai^ y 


(matrix) which satisfies 
(Pi . ^[Plxlpl . 


(2.4.18) 


Another construction, A^^\ defined exclusively in terms of matrices, 
is the compound of the matrix A (see also [16)), and a theory analogous 
to chat for A^*^^ is outlined. These two constructions are shown to be 
specializations of the censor product. Many other topics are treated in 
[C12], including controllability and observability, optimal control, sto- 
chastic differential equations, and stability theory. These ideas are ex- 
panded upon in [C13] where Brockett constructs a theory for control problems 
defined on spheres in which results from Lie theory again play a natural 
role. Results analogous to those for linear systems are developed for sys- 
tems of the type 

m 

x(t) - (A + [ u^(t)B ) x(c) 

i*l 

y - Cx(C) , (2.4.19) 

where A and are skew symmetric matrices and (2.4.19) can be thought 

of as evolving on Che sphere l|x(t)|! - |jx(0)||. 


Differential geometric methods are used in the treatment of singular 
optimal control problems in [C16]. Volcerra series expansions and function 
space Taylor series expansions are the main Cool in Che studies, as Che 

notation is utilized for Che expansion of the kernels. Here, however, 
an expression such as u^^^ (aj^,...,o^) is represented as a censor product 
u(Oj^) ® ... ® u(o^). Volcerra series and geometric control theory are ex- 
pounded in the often-cited [C18]. Again Che Volcerra kernals are computed 
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In cerms of the power series expansions of the functions defining the con- 
trolled differential equation. Some applications are considered, including 
singular control and multilinear realization theory. 

In [CIS] Brockett surveys some of the main results available then (1976) 
on the use of differential geometry in nonlinear system theory. To this end, 
background Information on manifold theory is supplied in the form of an ap- 
pendix. Some geometric aspects of linear system theory are studied in [C17], 
where single input-single output systems are ccnsidered (in the frequency 
domain) . 

The duality between controllability and observability for nonlinear sys- 
tems is investigated in [C19]. Instead of constructing a "dual" system (as 
might be done in linear system study but is a much harder problem for the 
nonlinear counterpart) the duality between "vector fields" and "differential 
forms" on manifolds is exploited, along with the use of Lie algebraic con- 
cepts. In [C23] the topic of nil|)otent Lie algebras is considered for the 
derivation of an optimal bilinear filter. 

W', cite two papers by Baillieul in which optimal control is dicusssed. 

In [C14] classical optimization techniques (the calculus of variations) are 
used in the context of Lie groups. Multilinear optimal control is treated 
in [C20]. There, the nonlinear differential equation 

X - A(t)x^’’^ , x(0) - , (2.4.20) 

where has elements as in (2.4.15), is solved by a particular series 

of successive approximations involving the terms The condition for 

solution is the convergence of such a series. Using operator norms and the 
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differential equation for the "k-fold Kronecker product", 

-~(x [ x®...OA(t)x^**^®...®x, (2.4.21) 

i-1 

where the term A(t) x^*’^ is in the i-th position, the condition for the 
uniform convergence of the series is derived. 

Another paper by Baillieul [C24] offers methods alternative to the 
usual Lie theoretic approach to the study of nonlinear systems. These 
methods are based on topics of algebraic geometry and manifold theory, the 
knowledge of which is assumed of the reader. Systems of equations of the 
form 

fnl " 

X ■ Ax^” y u.B.x ; x(0) ■ x (2.4.22) 

i-1 ^ ^ ° 

are created, as are systems of multilinear differential equations such as 
(2.4.20). 

Necessary and sufficient conditions for the invertibi] icy of a class 
of nonlinear systems are derived in [C21]. Included in this class are ma- 
trix bilinear systems for which Lie algebraic invertibility criteria are ob- 
tained. In [C22] an abstract realization theory for finite dimensional 
discrete time internally biaffine systems is presented. The affine censor 
product is introduced in terms of the ordinary censor product, then used in 
describing biaffine systems. 
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14. Porter, W.A. , "An Overview of Polynomic System Theory", Proceedings 
of' the IEEE , vol. 64, no. 1, January 1976, pp. 18-23. 
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III. MOTIVATION: SCHEDULING 


3.1 INTRODUCTION 

In eh« Applicacions , on* conanon way to daaign a control aystam for a 
nonlinaar plant la to locallza ita bahavior along linaa of oparation apac- 
Iflad by tha plant manufacturar, to davalop llnaar multivariabl* control* 
for thaa* localization* , and to achadul* thoaa control* with kay plant 
varlablaa which vary amoothly along oparating linaa. An Important part 
of practical daaign lora, tha art of controllar achadullng haa racalvad 
little modam attantlon from tha concaptual point of vlaw. 

Brlatol [17,18] haa llkaned tha procaaa of control daaign to the uaa 
of Idioms In a languaga. At laast thraa types of Idioms can be Identified. 
First, there are Idioms which have been with mankind for such a length of 
time that they seem universal to the human psyche. In some sense, feed- 
back Itself la an example of such an Idiom, Inasmuch as it may be traced 
at least back to ancient Arabian water clocks. Second, there are Idioms 
which are the characteristic of certain authors. Several classic examples 
are the Nichols chart, the Bode plot, the Evans loci, and the Nyqulst plot. 
And third, there are Idioms which are typical of certain types of control 
applications. An example Is that of gas turbine control systems [19]. 

Because of the Idioms of type three, any application of control de- 
sign has Idiomatic features. In ii sense, the task of the control designer 
Is to blend the Idioms of the application with universal idioms, with 
idioms of classical and modem authors, and with his or her own idioms, 
so as to produce a melodious and effective composition. 
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It goes without saying that Home idioms do not play well together. 

In some areas of appJifat Ion, this may account for the famous theory /ap- 
plication gap. 

One universal idiom is to attack the overall system design by breaking 
it down into manageable pieces. An important case of tills type of thinking 
irises in ttie design of certain classes of nonlinear systems. Examples in 
point may be found in the area of gas turbine control. In brief, the non- 
linear engine is linearized locally along lines of operation agreed upon by 
the manufacturer and the control contractor. These linear multivariable 
localizations are used to develop a family of local controllers, which are 
then sewn together by scheduling control gains and dynamics with some eng- 
ine variable, as tor example speed, which varies smoothly along operating 
1 inea . 

As pointed out by Bristol [17], the idioms have to blend together. 

Ill Liie case of scheduling, the methods used fur design of the local, linear 
multivur table controllers have to be amenable to u common thread of smooth 
scheduling, else a global whole is not obtained, but only a sum of parts. 

The goal of this section Is to examine in an Introductory way cer- 
tain of the conceptual questions associated with scheduling. What follows 
should be regarded as exploratory in nature. 
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3.2 SIMPLE EXAMPLE 


Consider tht slsmencary dynamical systom 

X ■ -ax + bu . 

Tha cransfar function assoclatad with (3.2.1) is of coursa 


b 

8 +a 

Rawrittan in tarms of gain and tlma constant, (3.2.2) bacomes 

k 

T8+1 ’ 


(3.2.1) 


(3.2.2) 


(3.2.3) 


whera 

k • b/a , T “ 1/a . (3.2.4) 

Suppose that we wanted to schedule tha gain k as a function of the input 
u, say 

k(u) ■ . (3.2.5) 

Then the scheduled system would look like 

2 3 

X ■ -ax + aOj^u + a^j^u 4^ aVj^u . (3.2.6) 

Alternatively, we might schedule the time constant t as such a function, 
for example 

t(u) ■ »2 ^ 2 '^^ ’ (3.2.7) 


ia which case we would have 


a - 1/ (o2 + 62“ + Y2U ) 
-1 -2 ^ 

■ 02 - S2“2 • 


(3.2.8) 


so that 


-1 -2 

X ■ -O 2 X + 8202 ux + bu + ... 


(3.2.9) 

on out to a denumerably infinite number of terms. Next suppose that we 
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T aa a function not 


wantad Co achadule Che n k or Che time conacanc 
of u but of X, in Che manner 

2 

k(x) ■ «3 Y3X . 

2 

t(x) ■ O 4 + S^x + Y4X . 

Then Che ticheduled ayacema would be 

2 

X • -ax + aOjU + aS^xu + ay^* u , 
-1 -2 2 

X • -a^ X + 84*4 + bu + . . . , 

again with a denumerably Infinite number of terms. 


(3.2.10) 

(3.2.11) 


(3.2.12) 

(3.2.13) 


Generally speaking, Che polynomlc scheduling concept tends to convert 
Che system (3.2.1) into a system of the form 


00 00 

* - I I • 

i-0 j.-0 

Indeed, if the original system were of the more general form 

00 00 

• r r , ® 

X - Z i ^km’' “ ’ 

k-O m-0 

and if the parameters were scheduled in an analogous way, such as 


00 00 


^ ‘ plo qlo “ 


Chen (3.2.15) becomes 


00 00 00 00 


k+p m+q 


» ■ ,_L _L .L .L 


(3.2.14) 


(3.2.15) 


(3.2.16) 


(3.2.17) 


k«0 m»0 p“0 q*0 

whicn can be formally rearranged in the same form as (3.2.15). In broad 
terms, then, (3.2.15) is closed under formal power series scheduling. 

Because of this closure feature, we find interest In systems of this 


type. 


50 


3.3 ABSTRACT SERIES 


As Inclnuicsd in Che section preceding. Che formal series Is a natural 
candidate In studies of scheduling. Various approaches can be made to the 
description of such series. Based upon Che background of Sections 1.2 and 
1.3, we wish to Indicate briefly here the viewpoint coward which we are 
tending at the time of this report. 

Consider a nonlinear state description of the general form 

X • f(x,u) 
for 

f : X X u X 

with X and U real vector spaces, equipped with norm. Let (x.u) be 
a point In X x u, and suppose Chat 

D*^f : Z -> L(X X U.....X X u.X) 

is available for r - 0,1,2,..., with Z open in X x u and (x.u) 
in Z. Then, formally, 

00 

- - p. 1 k - - fk^ 

f(x + Ax, u + Au) ■ I iTr f) (x.u) (Ax,Au) ^ , 

k-0 

(k) 

where (Ax,Au) ■ ( (Ax, Au) , (Ax.Au) , . . . , (Ax, Au) ) , the right member having 
(Ax.Au) k times. It should be recognized that this series could be re- 
placed by a finite number of terms together with a remainder. However, 
the above representation 1s adequate for brief illustrative purposes. 

Space does not permit a discussion of whether, or how, the series accept- 
ably describes the function. Along the same lines, we "ass over the re- 
lated question of how It affects the vector field associated with the dif- 
ferential equation, and therefore Its solutions. Instead, we remind the 

k * k 

reader that (D f)(x,u) is a k-linear function on (X x u) to X; and 
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this suggMts that wa can usa tensor algebra to parameterize it. Indeed, 

k 

denote by (Ax,du) this k-*foId censor product of (Ax.du) with Itself. 

k - - 

Then the k'llnear function (D f)(x,u) can be factored uniquely in the 
manner 

Lj^(x,u) o , 

where 

(•‘‘(X X u), 

is a Censor product for k copies of X x u, or what is sometimes called 
a kth Censorial power for X x u. In this case, Che kth parameter map 
operates in the manner 

L^(x,u) : X u) -*• X . 

We have, therefore, that 

f(x + Ax, u + Au) ■ I Lj^(x,u) 0 8 (Ax,Au) 

k«0 

• I L^(x,u) (Ax,Au)*^ . 
k"0 

Next consider the rearrangement of a term of type 

Lj^(x,u) (Ax,Au)^ . 

Consider, for example, the case k - 2, namely 

2 

(Ax,Au) ■ (Ax,Au) ® (Ax,Au) . 

Such a form does not relate directly to the structure of the section pre- 

1 ^ 

ceding, which would involve terms of type (Ax) ® (Au)' . However, there 

is a natural way to convert to that structure. Define projections 

TT :XxU-^U ; n :XxU-^X; 

u X 

and injections 
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: U ® U S ; 


: U • X S ; 




i ; X • U -► S ; ; X « X -*• S ; 

XU ’ XX 


S - (U ® U) X (U • X) X (X • U) * (X • X) . 


Then we can write 


(Ax,Au) ® (Ax,Au) ■ 1 (tt (Ax,Au) 9 ir (Ax,^u)) 

XX X X 


+ i (tt (i^x.Au) ® ir (Ax,Au)) 

XU X u 


+ i (it (Ax.Au) ® ir (Ax,Au)} 
ux u X 


+ i (it (Ax.Au) ® ir (Ax,Au)) . 
uu u u 


If we identify images of the injections with their domains, as for example 


i (U » U) - U ® U , 
uu ’ 


then we can write 


(Ax.Au) a (Ax,Au) ■ Ax 8 Ax + Ax ® Au + Au ® Ax + Au a Au . 


According to the conventions of ®(X,U), however, discussed in the section 


preceding, we agree co write 


Au 8 Ax ■ T Ax 8 Au 

ux,xu 


for an appropriate isomorphism T . In that way, we can v" o^^aed to 

UX p XU 


L 2 (x,u) (A x,Au)^ - L 2 (x,u)(Ax)^ 


+ L 2 (x,u) Ax 8 Au 


+ L-(x,u)T Ax 8 Au 

2 ’ ux,xu 


+ L 2 (x,u) (Au) , 


which we re-notate to (with factorials Included) 


••• mm 2 

L2q(x,u)(Ax) + L^j^(x,u) Ax 8 Au + Lq2 (^t.u) (Au) 


In this way, the formal expansion becomes 
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f(x + Ax, u + Au) "II L (x,u) (Ax)*' • (Au)^ 

i-0 J-0 

from which point we can axamlnc cha scheduling questions previously raised. 

The clear distinctions established by these notations are expected 
to make possible a deeper Investigation of the Issues of controller 
scheduling. 
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IV. VROGRESS IN PARAMETER SELECTION* 


4.1 INTRODUCTION 

The purpose of Section IV is to provide some visual Indication of pro- 
gress which Is being made on the Interactive approach for nonlinear tensor 
model Identification, simulation, and validation. 

To begin this process, we wish to recall the situation for previous 
computer studies of this type. Probably the quickest and most efficient 
way to do this Is to excerpt an example from the previous grant report, 
which was for the period from March 1. 1979 to September 30. 1980. This 
excerpt Is included In the following pages. It Is primarily a reference 
In subsection 4.3. 


*Contributed by Thomas Klingler. 
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Excerpt 

Pages 115 > 128 
Technical Report 

on 

NASA Grant NSG-3048 
March 1, 1979 - September 30, 1980 
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Th« intant of ehla chapter la to lllustraca tho noclona dlacuaaad In 
Chapear V with two rapraaantatlva caaa atudlaa. Tha flrat axampla la a aya- 
taa of two nonpolynomle » nonlinear differential aquatlona with two atataa 
and two Inputa. A dagraa-2 approxioatlon la uaad In conatructlng a modal 
of tha ayatem; following thla, a dagraa-3 approximation la dlacuaaad. Tha 
aacond axampla conalata of a ayatem of three polynomlc differential aqua- 
tlona of three atataa and three Inputa. A dagraa-2 approximation la uaad to 
generate tha third-order modal. The aquatlona of thla example are choaen 
aa auma of monomlala from tha tanaor producta to llluatrata tha manner In 
which tha Identification achema welghta tha appropriate paramatara of the 
linear oparatora In tha model. 

Simulation and verification of each model mak^ up tha bulk of tha chap- 
ter. Plota llluatratlng comparison of the almulatad, linear, and true so- 
lutlona are given, and axtanaive use of tha error analysla described In 
Section S.S Is made. For each model, an operating region of validity about 
the origin Is established. 


6.2 SECOND ORDER SYSTEM 


In this first example, let the state x be given by the 2-vector 

(x^,X 2 ) ond the Input u by (u^,U 2 ). Consider the system 

dx. 

fl(x,u) - ^ 

2u 

■ U 2 COSh(x^X 2 ) - e slnh(2x^) - 38lnh(x2> , 
dX2 

■ 3T 


“l“2 “l 2 

e sinh(x^) - e u^cosh(x^) + slnh(x 2 ) 
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Th« Input forcing function* art coslnuaoid* and ar* aach a function of two 
paramatar* , amplltuda and fraquancy. Notica that 

f(O.O) - 0 , 

to that tha origin la an aqulllbrlum point and will thua b* tha point of ax~ 
panalon In tha aariaa truncation approxlnation. 


Tha ilnaar oparatora which form tha atandard llnaar approximation ara 
calculatad according to 


and 








“2 


.”‘1 


_ 

_ 

-2 


1 

1 

!!i 


3u^ 

9uz 

!!i 

111 

3Uj^ 

Suj 


0 I 

-1 0 


( 0 , 0 ) 

( 0 . 0 ) 


( 0 . 0 ) 

( 0 . 0 ) 


Observe that is full rank; each function has linear terms in the in- 
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puts. Mortovsr, local stability of tha systan is ascartsinad by tha fact 
that has aiganvaluas with nagativa raal parts. Thus, tha origin is a 

stabla aquilibrium point. 

Conaidar a truncation approximation up to sacond dagraa tansor product 
tarms only. As discussad aarllar, idantlficatlon of an accurata modal ra- 
qulras that tha systui ba parturbad a small dlstanca from tha point of ax- 
pansion by choica of tha initial condition vector Xq. To this and, tha 
system is integrated with 

Xq - (0.005, -0.005) , 

while tha input amplltuda vector a is taken to be 

a - (0.05, 0.05) , 
and tha vector of frequencies is 

^ - (0.75, 1.0) , 

in hertz. The solutions to the coupled differential equations are then 
sampled at 200 time points, evenly spaced at Intervals of 0.02 seconds. In 
order to ensure accurate derivative estimates, the integration stepslze is 
taken to be 0.005 seconds. A degree-2 approximation results in a model com- 
prised of five linear operators, as the matrix equation 

* ^ ^ ■ 

* " ^^10 ^01 ^20 ^11 ^2^ *T • 

is formulated for the least squares minimization identification scheme. 

The linear operators for the above-mentioned formulation are given in 
the following: 


i 

i - 

i i - 

-2.001 

«■ 

-3.009 


0.002 

0.997 

f ' 10 

1.006 

1.011 

01 

-1.000 

0.000 

1 

U 
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f 


0.239 


0.145 


-0.720 



0.323 


-0.128 


0.359 


t 



-4.150 -0.074 -0.048 -0.176 

-0.007 0.083 0.008 0.102 


-0.105 0.027 0.012 

-0.982 0.015 -0.013 


Noe* chat and elosaly approximae* th* analytical •xpraaslons 

given by th* Jacobian matricas of firat partial darivativaa. Th* taak that 
ramaina, than, ia th* modal varification, praaantad in tha following. 


Verification taats involv* ntnnaroua aimulationa of tha modal for var- 
ious combinations of the parometars Xq, a, Two tests will ba given 
hare, the first of which consists of twelve different choices for x^, 
with nlna choices for a and one pair gives a total of 108 

simulations. Results of the east ara tabulated in Table 6.1, where f - 
(0.75, 1.3) for ell simulations. The two columns on the right of the 
table give tha values and c., for x^ and X 2 , respectively, as the 
maximum relative error between the model simulation solution and the linear 
approximation. As discussed in Section 5.5, a negative value for the 
indicates that the model has outperformed the linear approximation of 
and Observe that and are negative for all individual sim- 

ulations in this test, for single precision calculations. While these re- 
sults show that the model has outperformed the linear approximation in a 
region about the expansion point, comparison plots of these solutl''’'6 
against the true solution offer a final indication of the validity of the 
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model. To best illustrete the tracking ability, consider a simulation of 
the model with the initial condition set at (-0.01, 0.01) but with 

a - (0.25, -0.25) 

as the input amplitude pair, at the same frequency pair (0.75, 1.0). Sim- 
ulation of the model for these conditions is depicted in Figure 6.1a for 
variable and Figure 6.1b for variable x^. Clearly, the model solu- 
tion, curve C, tracks the true solution, curve A, well throughout the 
integration Interval. 

An interesting feature of this example concerns the sensitive behavior 
of f(x,u) for low frequency inputs; in the D.C. case, input amplitude 
steps of over 0.1 in magnitude cause instability in the system. The second 
test here, then, is for low frequency Inputs with small amplitudes. Four 
choices of <$), four '<5 a, and two of x^ are utilised, a total of 32 
simulations. Table 6.2 illustrates the results by way of the comparative 
error analyses where it is seen that the model again outperforms the linear 
approximation for the various conditions tested. The next two figures de- 
pict simulations of the model for two of these tests verifying its ability 
to track the true solution. In Figure 6.2 is given the response of the 
system for 

Xq - (0.01, -0.01) , 

o - (-0.075, -0.075) , 

<|» - (0.05, 0.05) . 

A step response (that is, for <(i > (0,0) in the test) is given in Figure 
6.3 at the same value for Xg and a. In both Instances the model simu- 
lation matches the true solution well while the linear approximation is 
poor. 
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Figure 6.1b 
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Figure 6.2b 
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Figure 6.3b 


4.2 SOFTWARE GOALS 


The intent of this phase of the research has been to devise an algor- 
ithmic procedure and implement it in the testing portion of the overall 
modeling scheme. 

According to Figure 3, the overall modeling scheme is broken up into 
three main divisions - LOADER, IDENTIFY, and SIMULATE. A brief description 
of each follows: 

LOADER - generates a Model Pareuneter File contaiuxng the number of states, 
number of controls, length of tensor term vector, degree of ap- 
proximation, and number of sample points. This routine also sam- 
ples the states and derivatives of the system and stores them in 
the Temporary Data File. 

IDENTIFY-uses the data in the Temporary Data and Model Parameter Files and 
generates a model using the SIMEQUAT routine in the SPEAKEZY 
package. The model is then stored in the Model File; and the Tem- 
porary Data File is deleted. 

SIMULATE-uses the data in the Model and Model Parameter Files and performs 
a comparative simulation between the true, linear, and nonlinear 
solutions. An error analysis procedure is also contained in the 
routine. 


The entire modeling scheme has previously been Implemented on the Uni- 
versity's IBM 370-168 computer system. Results from the use of this soft- 
ware have been very acceptable; however, the use of the system itself has 
become Increasingly difficult due to the immense number of users bidding 
for time. Consequently, It was advantageous to develop a modified version 
of the software and to implement It on Che Department of Electrical Engine- 
ering's DEC PDPll/60 computer system. 

Figure 4 Illustrates the peripheral units available on the PDPll/60 
system. Two of these units are of particular Interest In Che modeling 
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•ch«a«. The first Is ths Tskeronix 4023 vidso grsphics esrmlnsl, snd ths 
sscond is ths Vsrsstsc slsctrostselc prlncsr/plotesr . Uss of both thsss 
psrlphsrsls is s vslusbls plus in ths siaulation phsss, for ths trsjsc- 
tory curvss can bo quickly snd sssily displayod on ths Tsktronix tuba, 
snd upon roquast can ba spoolad to tha Varsatac plottar. This dafinltaly 
anhancas tha routlna snd improvas tha intarsetiva ability of tha modaling 
Schama. 

Anothar viiw indicstas that two drawbacks currently sxist with tha 
implamantation of tha modaling scheme on the PDPll/60. First, tha 96K 
of Cora memory is divided into thirds, with 32K being allocated to each 
terminal. Unfortunately 32K of memory is not a sufficient amount to per- 
form the identification phase of the scheme. Secondly, the POPll/60 docs 
not currently support floating point hardware. In other words, all float- 
ing point operations are presently performed in software which greatly in- 
creases the execution time of routines which contain a large number of 
computations, such as LOADER and IDENTIFY. 

With this in mind, work has been underway to institute an interac- 
tive nonlinear model identification and testing scheme whereby the PDPll/ 
60 computer will be linked via a data link to a Remote Job Entry (RJE) 
port on the IBM 370-168*. In this configuration, a user could sit at the 
Tektronix terminal and have both the IBM 370-168 and PDPll/60 facilities 
at his or her fingertips. Consequently, the memory dependent and r>ighly 
computational routines LOADER and IDENTIFY could be executed on the IBM 
370-168, and the Model and Model Parameter Files could be transferred to 

*Thls link Is not yet complete. 
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Ch« PDPll/60 wh«r« they could b« ua«d by th« SIMULATE roucln*. In this 
fauhlon, ch« SIMULATE routine could utilize both the graphics capabilities 
of the Tektronix, and the plotting capabilities of the Veraatec. 

Figures 5 and 6 contain flowcharts which describe the siDulatlon and 
testing phase of the modeling scheme. Specifically Figure 5 illustrates 
the order in which various program functions are performed. The systems 
(true, linear, and nonlinear) are integrated, using a unique set of initial 
conditions and control parameters, and the error analysis is displayed. 

From an interpretation of this analysis, the user has the option to: 1) 

print the simulated solution at the Veraatec; 2) display comparative sol- 
ution curves on the Tektronix; 3) store the comparative solutions in a 
plot file; or U) resolve the system^' using a different see of input para- 
meters. This portion of the routine. j.s highly .'nteractive and allows the 
user CO teat out a given model over a specified region. 

At Che Cermlnaclon of the roucine, if a Solution Plot File exists, 

Che user can execuce Che hardcopy plot procedure shown in Figure 6. This 
procedure uses Che Soluclon Ploc File and creaces binary parameCer and 
daca files which are used by che system routine RAS Co perform Che accual 
plocting ac Che Veraatec. 
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4.3 DEVELOPING DISPLAYS 


Th« following pages contain examples of the displays associated with 
discussions In subsection 4.2. These are self-explanatory and may be com- 
pared with the excerpt from the preceding technical report, which has been 
Included In subsection 4.1. In addition to comparison curves for .Igures 
6.1, 6.2, and 6.3 In that excerpt, some additional curves have been selected 
from Tables 6.1 and 6.2 to Illustrate the capability. 
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•••••*••••• PROBLEM SUMMARY ••*••••**••• 

CONFIGURATION. TRUE. LINEAR & NONLINEAR 
NUMBER OF STATES: 2 

NUMBER OF CONTROLS: 2 
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COMPRRRTIVE SOLUTION PLOTS: STATE « 1 

RUE A - LINEAR HODEL if - NONLINEAR MODEL 



TIME (SEC) 





COMPARATIVE SOLUTION PLOTS; STATE « 2 
RUE A - LINEAR MODEL * - NQNl INEAR MODEL 



TIME (SECI 




•»••••••*•• PROBLEM SUMMARY *•«••••••••• 

CONFIGURATION: TRUE. LINEAR A NONLINEAR 

NUMBER OF STATES: 2 
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COMPARATIVE SOLUTION PLOTS: STATE « 1 

RUE A - LINEAR MODEL ★ - NONLINEAR MODEL 



TIME (SEC) 




COMPARATIVE SOLUTION PLOTS; STATE 



'o.oo 1.50 3.00 ^.S0 6.00 7.50 9.00 10.50 12.00 13.50 15.00 16.50 

TIME (SEC) 






•“•*••••••• PROBLEM SUMMARY •*•*•••*•••• 

CONFIGURATION: TRUE, LINEAR A NONLINEAR 

NUMBER OF STATES: 2 
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COMPflRHTIVE SOLUTION PLOTS; STRTE • 1 
RUE A - LINERR MODEL * - NONLINEAR MODEL 



TIME (SECI 
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••••••••••• PROBLEM SUMMARY •••••••••••• 

CONFIGURATION: TRUE. LINEAR A NONLINEAR 

m«MBER OF STATES: 2 

NUH8ER OF CONTROLS: 2 
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COMPHRHTIVE SOLUTION PLOTS: STATE • 1 

RUE A - LINEAR MODEL * - NONLINEAR MODEL 



TIME (SEC1 




COMPARATIVE SOLUTION PLOTS: STATE • 2 

RUE A - LINEAR MODEL ★ - NONLINEAR MODEL 
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V. PROGRESS ON NONLINEAR FEEDBACK 
FROM TENSOR MODELS 

Work on chli aapoct of eho roaoarch has boon undorvoy only a fou 
moncha. Tho goal is to aaaoaa th-^ practical iaauoa Involved in an Implo- 
montatlon of tho nonlinear feedback achaeo propoaod by Buric [20] for uao 
on tonaor modola. 

In particular, It ia doairad to dotonalno exactly what ia ^nvolvad la 
calculating tho feedback gaino, to atudy whether the theory auat be applied 
without modification or whether it may be poaaible to begin with certain 
almplificatlon of method, and to carry out the aoftwara atapa needed to 
execute a nontrivial example. 

At the time of thia report, the group ia nearing completion of the 
flrat of the three atepa above. The principal iaauaa involved Cor th<* 
aecond of the three atepa appear to be the following: (1) How intrinaic 

ia the uae of duality, which neceaaltatea an indirect approach to vector- 
valued tenaora aid appliaa the loaa- chan- intuitive method of contractiona? 
(2) Should Che initial example employ the symmetric cenaor algebra, with 
its additional learning overhead but with computational advantagea, or 
ahould it employ Che easier and more InC’jlclve parent algebra embodying 
both symmetry and skew symmetry? 

Decisions on these Issues are expected to be made in the near future. 
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VI. CONCLUSIONS 


This raport has daacrlbad prograss on NASA Grant NSG-3048, antlclad 
"Altamatlvas for Jat Englna Control", during tha twalva month parlod ba- 
glnnlng on Octobar 1, 1980 and andlng on Saptamber 30, 1981. Includad 
hava baan raporta on modallng thaory, controllar schadullng, Intsractlva 
paramater aalactlon, and nonllnaar faadback from tanaor modols. 

In light of rapidly evolving capabllltlaa of mlcrocomputara and mlnl- 
computara. In view of tha qualitative tensor modal posalbllltlas astab- 
llahad earlier by Mr- Stephen Yurkovleh, and taking Into account both the 
state of the art and prospects for further advance In tensor techniques 
for feedback frora such models, wa believe that current progress continues 
to point out significant new opportunities for productive research In 
this area. 
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Saaanc aiaeuaaloiis la cha llcaracura hava 
,tolncaa auc cha aalacanea of daeoualaS eaacrol sya> 
laa aaaaalaa wtch high elaaaleal aarilno la cha la> 
dividual Loopa hue Uccla loop ccablllcy celaranaa 
e» lala varlacloa. Thia papar palaca ouc cha ap» 
pilcahlllcy of cha Crus-Parkloa aanalclvlcy aacrla 
CO daalfn problaaa lavalvtag suah plaaca, which aay 
ba foraaaaa wlch iraphlcally lacaraeetva aachada 
davalopad by Sehafar aad Sala. 

Iftcrodttccloa 

^aaldar cha ayacca of Fliura I. Sara r 
rapraaanca a vaccor of raauaaca, u a vaecor of 
eoacrol aecioaot aad y a vaecor of plaac raapoa* 
aaa. AaauM chae 

y • P u , (1) 

u • H r . (2) 

y • T r . (3) 


by Baatcaaaa (II. far cha eaaa la which cha plaac 
aacrla (P(a)j atlaaa fraa a caacrallabla aad ab- 
aarvabla crlpla (A.S.C) wlch S aoale. la par* 
clcular. chara aataca aa lacaraally acabla faadbacb 
raallsaclaa of Saagcaaea cypa for aacrleaa (N(a)i 
aad (T(a)l aaclafylni (i) if aad oaly If (H(a)j 
la propar and boch [N(a)| and (T(a)| ara aca* 
bla. for aa aacanaloa ca cha caaa (P(a)| propar. 
aaa (21. 



Caaa la poinc 


for approprlaca llnaar aparacora P. H. aad T. 
Coablaa ehaaa ehraa aquaclona to thac 

Tr • PMr. (4) 

and raaulra ehac (4) hold for all rapuaaea r. 

Than 

T - PM, (5) 

or la aacrla font 



Aay poaalbla eoacrol aetloaoplane raaponaa pair 
(u.y) eaa chua ba rapraaancad aa an alaaaae la 

kar (P i -11. (7) 


Tha Ineroduccory dlaeuaaloa abova laada rap- 
idly CO aoaa vary praeclcal (uldallaaa whan [T(a)| 
la dlaienal and nonalniular and whan [P(e)l la 
tduara. Thla la cha eaaa of daalrad daeoupllaB. 
Proa (3). (P(a)l will hava co ba lavarcibla if 
daeoupllni ;« co ba accalaad. 

Per dlaeuaaloa in chla papar. wa wiah co aaka 
uaa of cha anaapla _ 


9 

a^ 


8 

9 


77T 


acudlad by Rakaalua (31. who la cum accrlbucaa ic 
CO J.C. Doyla. A acralghefotwacd ealeulacioa chan 

glvaa 


whara cha kamal eaa ba eoaealvad alchar In vaecor 
tpaea or aodula chaoracle coraa. 

A vary broad cypa of faadbaek tyacaa within 
cha elaaa Indlcaead by Plgura 1 haa baaa acudlad 
*Thla work waa tupporcad In pare by cha Offlea of 
Saval Raaaareh uadar Concraec Suabar S 00014-79-C- 
0473 aad la pare by Cha Saclonal Aaronauelca aad 
Spaea Adalaiaeraelon uadar Orane SSC 304S. 


(P(a)r^ 

Por dacoupling. 

TCa) ' 


.9(04.1) 

‘S(f»-l) 


C^j(.) 

0 


10(c42), 
9(04.2) ‘ 

0 

Cj2(t) ■ 


(9) 

( 10 ) 
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(S) lapiiM 

(M(«)| • (Ki)|’^(T(«)| 

- ( “ 


(U) 



which for icccrMlly cccbla f*«4b«ch rMUMhUuy 
MhC h« K«M* cob tuhl* by ch« iMgctMh «o«4t* 
cloM. tiM ehaUa 



0 


T(i) • 


(12) 


0 



eha eanblelOM. ta (mc, chla 
raalUaC by aa oucyuc arnr (aadbaah 
of cha eyya ahawn ia ri|ura 2, whlla 
laearnal •eabllley, with eha ehaUa 



ahalaa «aa ba 
aan(t|uraelaa 
aalacalatag 


(13) 


Tha raaaana (at cha Inearaac aetraaccd by this 
aicaafla eaa ba aaylaiaab aa (ollawa. Tha facvard 
path gala 

(Q(a)l • [r(a)l(C(a)| (1«) 


la rt|ura 2 la 



Uaally, ehaa, cha cva-tapuc, cwa-oucpuc problaa 
baa baaa raduaaC co ewa otta>lnpue, ona-ouepue prob- 
laaa. itoraowar, each at cha ona>tnpuc, eaa^ucpue 
problaaa haa Iniloica tain aarcln In cha usual 
elasalcal sansa. Uaforeunacaly , eha Inflalea gala 
aargia la buc aa Ulualaa. at shown la eha follew- 
iBg saeeloB. 

Tha bay ea a seablliey racglo dacaeaiaaeioa, 
(or sa spsracor gala wteh aaerla 



loaareaa baewaao [?(■)) ta4 [G(a)|, la cha 
ralaeioo 

CLCr(s) - |l4>(?(a)l[X][G(s)1| OLCr(s) (17) 


rigvra 2. 



rigura 1. (Nae eo seals). 



rtgura 4. 

which gaaaraeas a seablliey region 

S ♦ bj » 0 (19) 

6 83kj - 78kj * k^bj » 0 (20) 

In eha (h.>k 2 ) plana. This region la skaeehaS in 
rtgura 1, «hl^ la noe, howawar. Srawn eo seals. 

For chla sbaeeh, eha bouadary o( (20) waa wrteeso 

bj • (6 ♦ 03li^)/(78 - b^), (21) 

and eha aaauapctoa lb- |<<78 gives a elosa apprea- 
laaeioa eo a scralghe Zina. Flgura 1 askas clear 
Chat vary saall ehaogaa la eha laageh at eoncrol 
spaea baala vaeeors can daseablllsa eha loop. 


baevaaa eha closed loop end open loop charseesrla- 
ele polyaoalals Cicr(s) sad OLCT(s) raapacelva- 
ly. For chla caao, (17) bacoaaa 

CUP(s) ■ s* ♦ (5 ♦ b, ♦ k,)s 

^ * (18) 


♦ (6 ♦ 83kj - 78kj ♦ b^kj , 


Saaftelviex Maerta Daslsn 

Tha seablliey aargin obsarvaeions at eha ewo 
saeeloas proesdlng are Inseruectva, In ehae ehey 
potae out eha poeanelal (allaclas which eaa ba as- 
saelacad wteh (Hear design ef concrol loops, whan 
seasletvtey aapaees havo noe bam eapllctcly eon- 
stdored. 
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rifuta i. 


Ut which 1C (ailcwc cticc 

ClCKc) • (.OlSf^ ♦ .OlSfc (I * hj • hj) 

♦ a * hj ♦ hj *• kjhj)) (.Omc * 1)* 


(aol) (ao2)* (a*l). 

(29) 

2 ♦ k^ a kj » 0 

(30) 

1 a k^ a kj a k^kj » 0 

(31) 


era cauacarvarea of (It) ac4 (20). The aaw acabU* 
ley ragiaa la akacehag In rigura S. 

Clearly, cha ahaya aa4 eharaaear of eha aeabtl* 
ley ragiaa ahawn la thia figure rayraaaaea a aub« 
aeaacial isyrovaaaae over that of figure ). la 
affaae, eha bauaharlaa aho«m la figure S ara vary 
yraaciaal, baeauaa (K) la (lb) baeeaaa alaguUr 
ae ehaaa yalaea. Aa a raaule, If(a)){K|, eea> 
aldarag aa a new ylane aaeria (f(a)). would be 
alagttlar aad eeuld nee yrodueo a daeauylad ayacaa. 


Ta loceryaraca ehia aayaee, we aaba uaa of 
eha ceayarlaaa aanaleivley aaerlr [4| of Crua and 
farhiaa, wiehia eha faadbaek acrueeure of figure i. 
far eha daalga of 0(a) aad H(a), wa aaka uaa of 
Cha aguaeioaa 

•I 


8 • T„ 


(X - So). 


(23) 


whara eha aubacrlye (0) danaeaa ooainal rayraaan- 
eaciona of eha ylane f. eha raayanaa oyaracor T, 
and eha Crua-farkUa oyaracor S, eha laae aacia- 
fying a wail known aquaeion 

Sg • (1 ♦ foM)’^. (3*) 

Ragard (22) and (23) aa daalga aquaelona In eama 
of a given plane and of apaelfleaelona on (Hear 
raayanaa Tg and canyarlaan aanaleivley Sg. far 
Tg, eheaaa (12); ehan wa nnlneaia eha aana noairul 
(Hear bahavlor obcainad la flgura 2. for Sg, 
ehaoaa 

••nsiSJHr^ • 

which rapraaanea an layrovoMae baeh In gain aad 
bandwideh ovar eha canyarlaan aanaleivley nacrix 


l$I ° 

. ® 

which oeeura In figure 2 whan [8(a)] 
la •eraighefotvard eo ealculaea 


la 1. 


(2ft) 


le 


(0(a)) 




(8(a)) 


a*2 


9(a«2)(.0139»ol) 

■ 3i»a ' 


§*1 


(27) 


( 28 ) 


fUne Charaatar 


The ayaclal eharaeear of eha Raknaiuo-Oayla 
axnsyla could hava bean foraaoaa bafora a daeauy- 
llng daaign waa eanylaead. To aoo ehia, naciee 
ehne a deeeuplad T(a) la coaflguraelan of eha 
figure 2 will alwaya ganaraea a diagonal farward 
pneh oyaraeian Q(a), aa In (16). Aa a conaa- 
quaneo, S(a) nay bo ragardod aa a pro-eonyanna- 
ear choaon eo aehiava coluaw doninanea of Q(a). 

A graphically Inearacelva proeaduro (or aaaoaaing 
auah quoaelona haa boon dovolopod by Sehafar and 
Sain (S,6|. Praconyanaaelon la eakoa eo ba of eha 
(am 


(2(a)) 


r2j(a)vjljj(a> 


rj^j(a)viljj(a) 

1 


(32) 


for a an alanane of a Nyquiae coneeur, paira 
(r^(a), which aehlavo colunn doninanea of 

Q(a) ara vlauailaad aa Inearlora of aolld clrelaa 
or Mcariora of daahad clrelaa in eha (r^, i^m) 
plana. Aa a (ollowa eha Myquiae concaur, ehaaa 
clrelaa ganaraea a CA80IAQ (Conplas MeepeabHiey 
Region for OIAa onal aanlnaneo) ploe.' flguraa 6 
and 7 give eha CARSX& ploca (or cha original plane 
(8) . How wriee (13) in eha fom 


[0(a) I • 

10/51 

P ”1 

(33) 

[8/9 

u 

L" *J 


■ [S(a)J 

(91) , 


(34) 

to figure 6, obaarwa ehae 

(8/9 

■ .888...; 

la jure 


alighely eo eha left of all cha daahad clrelaa; In 
flgura 7, (10(9 ■ 1.111...) la wiehln all eha 

aolld eirelaa. Ihua eha CA8D1A0 ploe pradieea col- 
uai doninanea of Q(a). Bowavor, eha alcuaelon 
uieh ragard eo ehia doninaaea coadieioo la praeart- 
oua, lanonueh aa (8/9) ronaina quiec cloae eo eha 
daahad eirelaa whHc (10/9) nuce be dalieaealy 
plaead eo ronain inaldo all cha aolld clrelaa. 
flguraa 8 and 9, and flguraa 10 and 11, praaane eha 
CARDIAD ploea of (?(a)) (or (kj^,kj) equal eo 
(0,».l) and (0,.l) raopocelvaly. The fomar la 
a aeabla eondieion, eha laetar unaeablo, aa aaaa in 
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t «i . «r . t •« t « t ff* f.n ? H I • in 

•t«W MHV 

figur* 10. 

Cfc^'oiio n9v :.i I 5f *wr9 i j 

la^M • 4. • 4. npt • t. *fM • \ 


rs rr: t, rr. ■ “...i ™ 

rt|uc. jLi. 

ct«oiio nst* 1.1 cur^Ti c3w i s/ csi^ > i i/sv^fe 
li^rf • I. V^Hn SMCff • 4. . i. . J 


I 



Fl|ur« 3. Fl|ur« 9 thow. eh«e eoluwi ewe fail* co 
be deaioaae «e all a; aod Flgucat 10 and 11 thow 
bach eoluona falling doalnanea—ralaelva ee (33)~ 
(34), Whan eh. doalnanea eondlelon faila, eh. In- 
dividual loop leabllley arguMnes baaad upon Reaan- 
brock'a eh«>rM [7] fall; and ehla la an Indlea- 
elon of robuaenaaa dlffleuley ee b. aspaeead In 
decoupling eh. plane. 
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SUHNARY 


Whan largo scalo. Intcrcinnoctcd system can be described In term o ' signal flow graphs, there Is 
available a natural algebraic way In which to regard generalized model "order reduction*. The basic 
Idea Is to regard the node variables as abelian group valued and to consider the mpplngs from node to 
node a< homomorphism of groups. Then variable simplification on node variables can be established by 
projections onto quotient groups. If the node*to>node homomorphism are correctly related to the ker- 
nels of these projections, then such a construction Induces a new set of unique node-to-node homomor- 
phism on the cosets of original node variables. One feature of the resulting quotient signal flow 
graph Is that It preserves the connection structure of the original system. Another feature Is that the 

f rejections Induced on node-to-node homomorphism are Interchangeable with basic flow graph operations. 
1,2 ]. This presentation reviews the notions above, extends them to the feedback case, and 

discusses the possibility for generalizations. 
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Tba ubtqutey of eha doeatalaaae of raeura 
dXffaraoea la elia*^a«aclaoe «ilel«artabla 
llaaar ayaeaa aeudlaa eaa ba acertbucag eo eha 
aulelvartabla faadbaek loop eoaerol praaaXane la 
■ueh lyaeawt Aa a link baewaaa opaa^loop and 
eloaad-loop eharaeeartaele pol/aoalala. aa eha 
fuadaMaeal aaeley laadlag eo aoee gaaaraliaad 
Syqutae leudlat, aad lodood aa eha kay quaoeley 
la tolvlag eha gaaaraliaad loopt ehla daeaeal- 
aane la of aaaaoelal algabrale laporeaoea* Coo- 
•aquaaely, axearlor algabrao doolgaod oaplleiely 
for eha analyala of tueh ealeulaeloaa aa daeor* 
olnaoea eaa ba of aaalaeauea In dlaeuaaloaa of 
aulelrarlabla ayaeaoa wleh faadbaek eooerol. la 
ehla papar eha baale uaaga of an axearlor algo* 
bra, la daearalnaneal eooaerueelona ralaelng eo 
eha polaa and taroa of ladlrldual eranafar fuae- 
elona la eha eloaad loop eranafar oaerlx, la 
llluaeraead. Whan lueh axearlor algobrao ara 
foroad orar eha lapue and ouepue raeeor ipaeaa, 
eha aap froa eha Inpue tpaea eo eho ouepue apaea 
Indueaa a oorphlaa ovar eha algabraa: ehla 
Induead axearlor oorphlsa playa a algalfleane 
rola In eha alauleaaaoua plaeaaane of poln and 
Individual soroa of eha eranafar aaerlx ae 
daalrad loeaelona, le la alao expaeeed ehae eha 
eoapace axpraaalona for eloaad-loop Individual 
taroa, randarad eranaparaae by eha axearlor 
algabrale aerueeura, would ba of ganaral laeoraoe 
laataueh aa ehay anhanea eha daalgaar'a abllley 
eo ahapa eha eranalane raapooaaa of Individual 
ayaeaa ouepuea. 

ItmtODUCTIOH 



flgura 1. Ouepue Faadbaek Serueeura 

Conaldar eha ayaeaa of Flgura 1, whleh eon- 
alaea of a aeablUaad axa plane eranafar oaerlx 
L(a) and an axa ouepue faadbaek oaerlx H(a) ovar 
eha flald F(a) of raelonal fuaeelona la a vleh 
eoaffleloaea froa eha flald F. Noee ehae r<a), 
u(a) and y<t) ara eha rafaranea, lapue aad ouepue 
orvaeeon, bolongiag eo FfaWoeeor apaeaa ft, 0 
and T raapaeelvoly, Tha daalgn of a faadbaek 
eoopaaaaeor H(a) aa la eha abova of eaa laada eo 
eha following aquaelon (eha dapaadanea oa a la 


droppad haaeaforeh for ooeaeloaal al^lleiey)i 

(X -*• L8)y • Lr. (1) 

Flgura 1 oay ba nawad aa followa, Ooea eha 
loop hoa boon elooad ehrough R, ehara roaulea a 
eloaad-loop eranafar oaerlx, havtag la lea 
varloua rowa and eoluoaa eha Individual eloaad- 
loop eranafar fuaeelona, la ouaaroua praceieal 
applleaelona, aa for axanpla [ll, apaelfleaeloaa 
ara glvan la earaa of eha raapoaaa of Individual 
ouepuea eo individual rafaraneaa, Thla oaana 
ehae eha taroa of Individual eloaad-loop eranafar 
fuaeelona ara of eonaldarabla loporeanea la 
daalgn, 

Ralaeivaly lleela aaaaa eo havo baan wrleean 
oa ehla aubjaee, Tha raaaona for eho paueley of 
Ilearaeura la ehla ana oay baeoaa elaaror If ona 
waro eo look, again, ae Equaelon (1), Uharoaa le 
la gonarally aeknowladgad ehae eha raeurn-dlffar- 
anea nertx (I ♦ LR) playa a hoy rola la daear- 
ololng eha affoee of faadbaek eonnaeelona on eha 
ouepue roapouaao (2], eho axpllele aacura of 
eha rolaelonahlp and eho praelaa way la whleh eho 
rteurn-dlffaraaea aaerlx aaeara eho dynaalca of 
eha foodhaek eoaerol problan hava boon dlffleule 
eo aeudy, Thla la baeauaa eho roeurit-dlffaraaea 
aaerlx la gonarally axpraaaad la eha faadbaek 
probloai aa eho Invoraa of a oaerlx aua. 

Building on eho work of Sain [3] ona eaa 
eonaeruee an axearlor algobrale aerueeura [4,9, 

6] auieod eo raproaone elaaaleal adjolaea and 
doearalnaaet and hanea, by doflnlclon, eha In- 
varaa of eha raeura dlffaraneo aaerlx, le haa 
already boon daaooaeraeod ehae ehla axearlor 
algabrale aerueeura la a uaoful and aaally 
appUod eonaerueelon for polo aaalgnMne la aa 
loporeane elaea of olnlaul daalgn problaav [7,3, 
91, 

Tha pnaaae papar oay roughly ba dlvldad la- 
eo ehroo parca, Tha flrse pare laerodueaa eha 
axearlor algobra. Tha praaoneaeloa la oxeroMly 
brlaf dua eo lloieaeioaa of apaea: for aoro do- 
ealla eha raodar la rofarrad eo Sroub [4J. Tha 
aoeoad pare of eha papar eoaaldara eha oulel- 
varlabla eoaerol probloa wieh full ouepue feod- 
back, Baaad oa eha axearlor aorphiaaa Induead 
ovar eha algabraa, axpraaalooa ara obealaod for 
eha polo polynoalal and Individual taro poly- 
ooxlala of eha eloaad-loop eranafar aaerlx ra- 
laelag eha ouepue voeeor eo eho rafaranea vaeeor, 
la eha laae pare of ehla papar eha abova axpraa- 
tlona ara uaad, la eoneare wleh unley rank fead- 
baek, eo plaeo polaa and Individual taroa alnul- 
eanaoualy, Oapandlng on eha nuabar of tpaelfl- 
eaelons glvaa, oaa oay ba abla eo aiehar placa 
eho polaa and taroa praelaaly or aoka a laaae 
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ORIGINAL PAGE IS 
OF POOR QUALITY 


■qiuras •pproKtanea pUe«Mae« An puapla ot 
ehia la taelud«4« InvolTtai soluelon uslni a 
eoapuear pro|taa> 

THE EmRIO* AtCE«iA 

Conatdar eha r(t)~vaoeor apeea (I of lapueat 
wtiaira FCa) la eha flald of riteloaal funcetona la 
a vteh eoafflelaaea froa eha flald r. Aa alaaane 
of eha vaeeor apaea U would .a aa lapue waoeor 
u(a): la auMrtoal ealeulaeioaa, u(a) would ba 
rapraaaaead bp * eoluaa waeeor whoaa alaaaaea ara 
raeloaal fuacelona la a. Aa aaeartor algabra AU 
eaa ba eonaerueead ovar eha waoeor apaea U (A]« 
Tha blllaaar oparaeor laeroduead bp ehia eoa- 
aeruceloa la eoaaoalp eallad eha aaearlor proifaiee 
or eha 'wadia' produce a, aad oparaeaa aa 

(oiai * 0202) AO]* aiaiAa3 * 02*2^03 (2) 

•lA(oia3 * 0404) ■ 03aiAa3 * ( 3 ) 

whoro ai, 02103,04 bolong- eo eha aliobra AU, oad 
>li>2i*3i*4 ara ftald alaaaaea froa f(a). 
Furehoraora, eha oparaeor a la ahaw-apaaoerle. 

Mow eoaaldar eha aap I. froa eha lapue raeeoc 
apaea U eo eha ouepue vaceor apaea Y. If wa eoa- 
teruee eha aaearlor al|obraa AU aad AY owar eha 
vaeeor spaeaa U aad Y roapoeelwalp, eha aap t, 
ladueaa a ualquo aorphlaa owar eha alpobraa 
[5 1, which la juae a aaquoaea of aapa L|i over eha 


aaearlor spaeaa, aa 

shown la 

Flgura 2. 

F(s) U 

A2U 

AfeU A,U 


|L$ . 

• jMt • • 



i 'if 

F(S) Y 

A2Y . 

. A^Y . . A,Y 

Flgura 2. ladueod 

Cxearlor 

Morphia* 


la eartta of auaarleal ealeulaelona, eha aap 
U la rapraaaaead bp eha faadforward eraaafar 
aaerla, taeh of whoaa alaaaaea la a raeloaal 
(uaeeloa la as eha aaearlor aap la 
obealaad bp foralai alnora of ordar V. froa eha 
aaerlx L aeeordlag eo a pradacaralaad toquaaeo 
dapaodaae oa eha ehelea of baala la aaearlor 
ipacaa [10 1 . Alao, le haa baan aaauaod bora ehae 
eha auabar of lapuea la eha aaaa aa eha ouabar of 
ouepuea and aquala a; ehua would ba rapro- 
taacad la auaarleal ealeulaelooa bp eha daearat* 
aane of eha aaerla 

?<OLTIVA«TAaLZ CQMTEOL WITH FULL OUTPUT FEEBEAOl 

Lae ua aow eoaaldar aapraaalooa for ladlvld** 
tial oloaad~loop eraaafar fuaeeloaa la a geoaral 
oaaa sueh aa thown la Flgura !• Hare L la eha 
faadforward aaerlx aad B la eha ouepue faodbaek 
aaerlx. Tha faodbaek aaerlx B la full, la 
gaoaral, and la rapraaaaead aa 


l^ll 


hi2 


•>la 


U>.1 


Nb2 


<4) 


Searelag wleh eha aquaeloo ralaelag eha oue- 
pue vaeeor p eo eha rafaraoea vaceor r, aaaalp. 


(1 * Ll)p • Lr 


( 1 ) 


oaa eaa uaa eha *wadga* oparaeor a aaaoelaead 
wleh eha aaearlor algabraa (101 la ordar eo lao> 
Uea eha eloaad loop eraaafar fuaeeloa ralaelag 
eha arblerarp a^** ouepue p, eo eha arbierarp b^** 
rafaraoea r^,, aaaalp p^/r^, aa 


Fa dae(I-*cfl) - daea-H.H) (5) 

rj " daeitHiii 


whara ll aad eT ara Idaaeleal eo eha foadbaek 
aaerla B axeape ehae eha a^^ eoluoaa, eorraapoad- 
lag eo faodbaek of eha a^" ouepue p,, ara aparaa 
as shown balow. 


Till . 
• 

. hi»>i 

a 

0 

*»lafl • 

a 

• hi, 

a 

• 

hb-11* 

a 

• >'b-la-l 

• 0 

a 

hb-la*l • 

* 

• hb-i« 

hbl . 

• **ba”l 

1 

hbavl 

. hb. 

*^11* 

a 

• *‘b4-la-l 

a 

0 

a 

*‘bwla+l • 

a 

• hbwi, 

a 

JW • 

• Nia-1 

a 

0 

a 

h^.^1 • 

• >4 . 

Till . 
* 

• Ma-1 

a 

0 

a 

hla+l 

a 

• hi* " 

a 

* 

J>*l * 

a 

• Nia-1 

0 

a 

0 

baa+1 

.hi,. 


Thus eha a‘^ eoluaa of B Is all saro whlla eha 
aA^ eoluaa of B haa a slaglo 1 la eho bAh row. 


tfa eaa aow sxpaad eha auasraeor and danoal- 
oaeor of Equaclon (3) la earao of suaa of cracaa 

[AI aa 


Fa 

Ab 


( (l+er(U)-^ra2a2>*”-*^A«ifti) 


-l-er(U)-cra?H^-..»era:a;;) I) 
i-kr<lk)wtr<i,|5|)v*. .nriLps; 


( 8 ) 


Tha nuaaraeor of Equaeloo (8) abova eaa ba 
raarrangod [10], basad on eha Uasarlep of eha 
eraea oparaeor, so ehae eha elosad loop eraaafar 
fuaeeloa ralaelag eha aA^ ouepue eo eha bAh raf- 

araaea Is sJ^tasaad as 


( er(ua-tt) I+er (LgCHj-fff) 1 


U 

Ab 


-^..wert ■ 

l-^erltaj^er 11.282 1 


J) 

:?erlL4H41 


(9) 


Tha abovo elosad-loop axprosaloa for eha eraaafar 
fuaeeloa p«/r^ eoneaias a cartia la eha auaaraeor 
aad eama la eho danoalaaeor: ehls eould ooao 
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« loe at eacm It ■ ta Ur|t« lf> homvar, ■ la 
■a4acaea. aay ■ ■ 3 eorraapoodlni eo ftva 7aC> 
araocaa aa4 tin ouepuca, eht auabar at earaa la 
Bquacloa (9) would aeeually ba qulea aaall« la 
aielMt eaaa eha auabar at earaa la llkaly eo ba 
raduead baeauaa le dapaoda oa eha auabar at 18> 
dividual faadback loopa ehae ara eloaad aad, 
ulelaaealpi oa eha raah at eha faadback aaena !• 
Thla (aee ta uaad la laear aacetooai whara eha 
aaeraaa eaaa of ualey raok faadbaek la eoaaldarad 
la ordar eo obeaia alapU aapraaaloaa for eha 
eloaad loop pola polyaooial aad ladlvldual aaro 
polynoolala* 

lae ua oow eoaaldar. ta oora daeall. eha 
oaerlcaa la eha auaaraeor of (9). loeauaa ft aad 
H ara alooae Idoaeleal, eha oaerla 

IS • n;; ao) 

will ba aparaai Spaelfleally, eha aaerla (10) 
oay ba ealeulaead via flrae obealalag a aaw oaerla 
ars)(a) of ordar rl froa B by aerlktag oue eha 
cow aad a^" eoluaa of 3, aad ehoa ealeulaelag 

<H(bXa))k-l- 

Thla la eoaaiaeane wleh eha caaule obealaad la aa 
aarllor papar (111 ehae eha aaroa of eha eraoafar 
funeeloa rataelag eha a^^ ouepue eo eha b^^ raf*> 
arooea eaaaoc ba aovad by aaana of faadbaek froa 
eha a^^ ouepue or eo eha b^^ roforoneoa 


Corraapondlag eo ehta rodueeloa of (10) eo 
fora eha rodueod oaerla (8(b)(a)^~l> ■•brla 

eo whleh ehla aaerla la eo ba ailelpUad oay 
alao ba roduead la tlao eo laeluda oaly ehoaa 
aloooaea whleh ara lovolvad la eha oaerla produce 
aad ta eho eraeo ealeulaelona^of Equaeloa (9). 
Raeall ehae eho alaaaaea of ara all poaalblo 
■laora of ordar k forood froa eho faadforward 
aaerla (•• Tho pare of Lj^ rolovaae hara eonalaea 
of ehoaa alaaaaea whleh roaule froa alaora of L 
of ordar k ehae laeluda 1^^, l^b balag eho faod- 
fotvard eraoafar fuoeeioa rolaelag eho a^^ oue> 
pue eo eho b‘^ rafarooco (10). Thua eho produce 
Involvoa eha roduead faadforward oaerla (lik)ab 
aod eha roduead faadbaek aaerla (R(b)(a)^ic>l 
ehae eho eloaad loop eraoafar fuaeetoa rolaelag 
eho a^^ ouepue eo eho b^^ roforooea nay ba 
aaproaaad aa 

Uab'^fta2)ab«(b)(a)l-^tl<I*3>ab<a(b)(a)>2 1-*" 


fb 




( 12 ) 


aae. Xa addieion. wo eroae eha apaeial eaoa 
wharo eho ouepue faadbaek oaerla la roaerleeod eo 
ualey raok by pradoftoiag lea aeruaeuro la dyadic 
fora> Ubaraaa ehla roaerleeloa rodueoa eha aua> 
bar of rooea ehae eaa ba pUead arblerarlly, le 
haa eho aeroag advaaeago of rooulelag la a bl> 
llaoar rolaeloaahlp boewaaa eho faadbaek oaerla 
and eha eloaad loop eharaeearlaele polynoalal, 
ehua oloplifylag eho ealeulaeloa of eho foadbaek 
ooerlat haaea le hao aeeraeeod eooaldarablo 
aenoneloa la raeane yaara (12,13). 

(hir approaeh eo ualng rank'^aa faadbaek la** 
volvaa eho olauleaaaeuo plaeonaae of poloa aad 
eoreala ladlvldual aaroa of laearaae. Tho goo- 
oral aopraaaloaa for eho eloaad loop poloa and 
Iffiflvldual eloaad loop aoroa, la eha eoao of 
ouepue faadback by onana of a oaerlx H, have al- 
ready boon dorlvad la eho provloua aaeeioa; rig- 
ura 1 ta ralovane hero, lae eha foodbaek oaerla 
3 ba a^^reaood la dyadic fora aa 

3 • fg* (14) 

whara f and g belong eo ehae la, 

f - (fl..f,)*, g - (gp.g,)^. (IS) 

Tha eloaad loop eharaeearlaele polyaonlal of eho 
ayaean oay bo aaproaaad la earaa of eho open loop 
eharaeearlaele polyaonlal aa 

cicr • deed * LHiour. (ii) 

la eho provlotta aaeeioa, wa «aw ehae daeCl^UlI 
oay ba wrieeon aa a tua of eraeea aa 

dae(l-K.3l-l-Kr(Ul)-*^ra5B2)*..nr(li8i) (17) 

whara ^ la eha k^** aaeerlor nap Indueed by eho 
oap 1. Baaed on eha above aquacloa and on eho 
aaauopeton ehae eho faadfonnrd aaerla I. la 
adjuaead ao ehae lea connoa danoninaeor, dan L, 
la eho open loop eharaeearlaele polyaonlal, wa 
eaa rowrlea Equaeloa (16) for eho eloaad loop 
eharaeearlaele polyaonlal (CLC?) aa 

CLCP > (l4>er(UI)<4..4^r(t4an>I<iani.. (18) 

Baeauaa eho foadbaek oaerlx 3 haa rank ono, eho 
ladueod aaeorlor oapa 3^, k * 2, o, ara all 
aero, ao ehae eho abova aapraaalon al^llfloa aa 
ohown balow, ualag eho dyadle dooerlpeloa of 3 la 
(14). 

CLCP " [14^r(Ul)Idaa L ■ dan L * g^(aun L)f, (19) 


ROOT PUCEMEHT UHPER RAWC-OWB TODBkCK 

la eha pravloua aaeeioa, aapraaolona warn 
obealaad for eho arblerary Individual eloaod loop 
eroaafor funeeloa, ehae la, for alononea of eho 
eloaad loop eraoafar aaerla, wieh faadbaek fron 
eho a ouepuea eo eha a eoraarlaoa potaea. 1a 
ehla taeeioa, vn uao ehoaa oxpraaaiona la ordar 
eo doalgn a eoaoeaae ouepue foadbaek aaerla 3 ao 
aa eo place eha poloa and earcala aaroa of laeor- 


whara oun L la eha nunaracor of eha fa« .otward 
eraaafir aaerla L. Rowrieiag eho oxpraaalon (19) 
la ordar eo aeaea aapUelely eho dopaadoacy on a, 
and ealUng eho CLCP aqulvalaaely aa eha pole 
polyaonlal p(a). wa ehua have 

p(a) ■ den L(a) v g^(aun L(a)]f. (20) 

Btneo la order eo place eha eloaod loop poloa of 
eha tyaeon wa would oaod eo flad tuleablo valuoa 
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for eho eovroMaeo s >04 f of eiw foodbock ooerix 
H to choc eho rtdhc~hoad otdo of Bquoeion (20) la 
tdoaeleal eo p(a)« AatiaHog ehae wo ara Ineor* 
oaead la plaelaf a polao, wa would havo o blUif 
oar aquaetoaa In 2a uakaotma aad f^ 

...•fg. Tho approaeb eo aolrtag ebla problaa, if 
wo wora eo ploes oalp poloa aad Itaoro eha ladt* 
wlduol foroa, would dapoad oa eha ralua of a la 
eo^arlaoa eo a. dowawar wa ara laearaaead la 
plaetac aoaa ladindual aaroa alao la addieloa eo 
eha polaa, aad hauea wa will dafar aolueloa of 
eba problaa uaeil wa hava rawrleeaa eha ai^raa- 
aloa for eloaad loop aaroa la a eoavoalaac fora 
ao ehal thi prablM lap bo «ppvoaehad la a eoar> 
prohoaalva aannar. 

Juae aa eha aspraaaloa for eha eloaad Loop 
polo poLynoalal waa ala^liflod eooaldorablp ba- 
eauaa eha faadbaek La of ualey rank, ao alao la 
eha aapraaaloa for eha ladlvtdual aaro pol/oo* 
alal vhleh la eha ouaaraeor of eha eraoa- 

for fuaeelon rolaelnt eha eloaad loop ouepue y, 
eo eha rofaranea rb> Spaelfleally, If eha plane 
haa a raforaoeoa and a ouepuea wleh faod'oaek frea 
all ouepuea eo all eoapartaon polnea, eha aapraa> 
a Ion for eha ouaaraeor of eha eloaad loop erana- 
for funeelon wleh rank^ona faadbaek baeoaaa 

(■J^Jnua ■ ^ab'*'^t ^^2)ab*(b)(a) 

wtaara wa raeall ehae (l>2)«b I* • aub-aaerlx of Lj 
obealnad by Ineludtng only ehoaa alnora of ordar 
ewo whleh Inwolwa l^b* alaoi H(b)(a) 
aaerlx of eha faadbaek aaerlx a, obealnad by da- 
loelng fron a eha b^^ row (eorraapondlag eo eha 
rofaranea rj,} and eha a‘" eoluan (eorrooponding 
eo eha ouepue y«), aa dlaeuoaad In eha pravloua 
aaeelon. Saeauaa wa wleipllad eha danoalnaeor 
of eha eloaad loop /g/tb ajpraaaton by dan t> eo 
foe eha pola polynoalal p(a), ao alao do wa aul- 
elply eha ouaaraeor, aa daacrlbad In Equaelon 
(21), by dan L and obeain eha Individual eloaad 
loop ouaaraeor polynoalal or taro polynoalal, 

Thua 

<tb(*) ■ n,b(a)'Hr((l2)tb^(b)(a)l^«n (22) 

wharo *ab(a) and Oab(a) ara eha caro polynoalala 
of eha eloaad loop and opan loop eranafar fune- 
elooa, raapacclvaly, ralaelng eha a^** ouepue eo 
eha ba" rafaranea, luae aa eha faadbaek aaerlx a 
haa boon axpraaaad aa eha ouear produce of w 
langeh vaeeora f and |, wa ean alallarly axpreaa 
eha aub-aaerlx a(),)(,) ao eha ouear produce of 
(vl)-langeh vaeeora, aa 

“(b)(a) “ *(b)*(a)^' 
whara f(^) - <fi-.fb-i*yn 

and f^,) - («i..f,-if,v.fla)^* 

Than 

*ab^*^ ■ “ab^*^'*'(a)^^*'2^ab^*^*(b)'^*"‘‘^*>‘ 


Equaelon (23) abova la eha daalrod axpraaalon for 
eha eloaad loop aaro polynoalal of bl- 

llnaar la eha arfuaanea g(a) and f(b)« Oapandlng 
on eha nuabar of aaroa ehae ara of parelcular In- 
earaae and naad eo ba plaead, wa will hava eor- 
raopoodlng aquaelona for eha caro polynoalal, 
alallar eo (23). 

RtCUMlVI fOLE AMO 2EK0 mCBUMT 

Equaelona (20) aad (23) for eha pola poly- 
noalal and eha individual aaro polynoalal, ra- 
apoeelvaly, nay now ba uaad eo plaea poloa and 
aaroa of eloaad loop evanafar funeelona la apael- 
flad Locaclona, Eaeh plaeaaane ean ba dona 
axaceiy II Iha nuahnr Pf dUirad polaa plua 
aaroa, nva, doaa noe axeaad 2ar^l [UU dii 
oehor hand. If ehla aua doaa aseaod 2a-l, a laaae 
aquaroa approxlaaea plaeaaane nay ba aada. 
Ualghelng la alao poaalbla eo raflaee eha rola- 
elvo laporeanea of aoaa rooea ovar oehara, 

laauaa ehae wa wlah eo place n polaa, ae 
^l,**>t*a* aaauaa ehae wa wiah eo plaea a 

eoeal of a aaroa, ae ui,...,Us, ehla eoeal balng 
eha aua of dlffarone nuabora of aaroa aaaoelaead 
wleh eha varloua eranafar funeelon nuaoraeora of 
inearoae, Tha polaa and eha aaroa aiae ehan aae- 
Lafy eha pola polynoalal (20) and aa approprlaea 
aaro polynoalal of eha fom (23) raopaeelvaly, 
Thua >ia hava a aquaelona 

p(l^) ■ danL(lj)+g^tnuaL(lj)lf • 0 

a 0 

p(X^) . danL(^„)Vto««‘‘(^B^le ■ 0 (2‘) 

for eha a polaa, and a aquaelona 

*ajbj(“l) • «ajbj(“l> 

■^(a,)^^*'2\b,(“a^*(b,)'‘*‘^^“a> * ® 

for eha a aaroa, Tha aubaerlpea aib\,.,,,aBb 2 
ara aaane eo aaphaalaa ehae eha Individual aaroa 
eo ba plaead ara aaaoelaead wieh dlffarane erana- 
far funeelon nunaraeora In ganaral, ehough oora 
ehan ona any ba aaaoelaead wleh eha aaaa suaara- 
eor, 

Equaelona (24) and (23) ara ova blUaaar 

aquaelona In eha 2a unknowna Sa,Il>«**,fa* 

Tha aquaelona am blllnaar In ehae for a glvan g 
eha aquaelona ara llnaar In f, and for a glvan f 
eha aquaelona am llnaar la g, Tmaelng g aa a 
eonaeane, eha aquaelona ean ba fonailaeod aa a 
aae of llnaar aquaelona la f aa 

Pf > e (26) 

wham P la a eonaeane (ota) x a aaerlx, and e la 
eha (nia)-vaeeor 
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a ■ (•4«aL(Jll),>>.~daaL(XQ), 

4Ieanaetv«l)ri eraaelag ! aa a eoaaeaoe. eha 
aquaeiona oaa ba fetmilaead aa a «ae of Uoaar 
aquaclooa ta • aa 

Qg ■ e (27) 

uftara Q ta a eaaaeaae (txH) a a aaerta, ao4 o ta 
eha (ffhi)*taageh vaseor daftoag abova* iloetea, 
ta foraUaetag Cquaetaaa (26) ao4 (27), ehae aach 
plaeaoaae aquaetoa cooertbucaa oaa row eo P ao4 
eo Q« Tha pota plaeaaaae aquaetoaa aueh aa (24) 
eoaertbuea rowa of laogeh m% Tha aaro plaeaaaae 
aquaetoaa lueh aa (29) eoaertbuea rowa of toageh 
■•1 oni/i a tare ouae ba ptaead ta ehaaa rowa ae 
eha bt" poatetoa It eha roforaaea of tneoreae ta 
bu ta (26), or eha ouepue of taearoae ta a^ ta 
(27), eo brtag ehaaa rowa up eo toageh a. 

Bquaetoaa (26) tad (27) oap oow ba tolvod 
racuratvoty ta eha laaae-aquaraa aoaaa by eha 
followtag algorteha eo otatotaa eha error fuoc> 
etoa 

«■ I p*(^tH ! 

t-i j-i ^ 

■ I iPf-cl |2«| iQg-cl I*. (2$) 

la addteioa. If aoaa rooc plaeaaaata are oora Ur 
poreaae ehaa oehara, ehta aay ba rafloeead ta a 
dtagooat, tararetblo oacrla of watghea 

tf ■ dtag(wi...Wg4,} (29) 

to ehae eha error funeeioa would ba oodtftad eo 

" j, 

•IIW(Pf-c)l|2-IIW(Qt^)l|2. (30) 

3eaa ana . Aaauaa aa latetal raluo of g ■ g^^A 
nan eha laaae tquaraa tolueloa of Equaelea (26) 
(or f ta baown eo ba 

f(l) . tP(g(l))l^c (31) 

whara * daooeao a auteabta paaudo*>tararsa« Tha 
aarrta f* ta al^ly ealeulaead whaa eha (a:^) a a 
oaerta P(g'^0 la of full rank a> If eho Ueear 
e^o^teton la aaelaftad by a auteabta aataeeton of 

[P(g(i))|+ . (pTp)-lpT. 

Thua can bo ealeulaead, and eha laaae- 
tquaraa error of Equaeton (26) la ehon given by 

El • llP(g^^>)f^^> - ell^. (32) 

Scan ewe. See f ■ f^^^ and obeata eha lanee- 
tquaraa aoluclon of Equaeton (27) for g aa 


g(2) . fQ(g(l))J-*c. (33) 

Tha laaae tquaraa error of Equaeton (27) la ehaa 
gtvaa by 

Ej • IIO(f<”)gf*> - ell*. (34) 

Thta proaata ta ropaaead In eho follMiag 
onnaar. Tho updaead valuo of g, naoaly g^*', to 
uaad ta aeap oaa, and a now valuo of f, oaaoly 
f^*', ta ealeulaeod uatng (31). Thoa.eha laaae 
tquaraa error I3 ta eoopuead uatag g^*' and V**. 
Naae eha updaead valuo of (, nomly f^*\ ^ uood 
ta aeop ewe and a now valuo of g, ooaMly g'*', ta 
ealeulaead uatag (33). Tha Itaae oquaroa error 
E^ la now ealeulaead uatag f'^' and g'^ • Thin 
preeadura la eonetnued uneil eho laaae-tquarea 
error E la aufftetoaely aanll. le haa boon ahown 
[lOl ehae eho laaae-aquaraa error funeeioa E la 
guaraaeeod eo eonvorge. 

EXAWU 

Tha eranafer oacrla, 1(a), of a plane la 

given aa 

rr*6 2 2a-^9 

6 -rvl 3a-a« 



Lae ua aaauaa ehae wa wtah eo Icaap oaa of eho 
polea ae -2 whlla aovtag eha ocher froa -3 eo 
-10; ehua 

ll • -2, • -10. 

Alao aaauaa ehae wa wane eo aovo eha (2,2) aaro, 
■22» praaone locaelon ae ^1 to -S la eha 

lafe half-plana while anaurlng ehae eho (1,1) 
taro, ail, reaatna uoaffaeead by faadbaek. 
Tharafora wa hava evo aora apaetfleaetona 

aii(a) • f+6, t22(a) • a^9. 

Aaaualng ehae wa are looking for a dyadte eoa- 
aeane faadbaek aacrtx 

H - fg*. 

ehta problea waa run on eha dlgieal eoapuear, 
uatag eha learaelve algorleha oueltned above, 
aearelng froa an inlelal value of g aa 

g - (1 I l)T. 

Tha prograa eoavargad eo a aolueion in five 
learaetona, wteh a eorroapoadtag loaoc-aquara 
error of eha order of 10*«(-20); eho eorraa- 
poadlag final vnluoa of f and g worn 

f • (. 13,-1.87, 1.97)T, , . (.06,1.37, .69)T 

wham wo hava rounded eo eha aaeond doelanl plaee 
for eonvantaneo. The faadbaek aaetin a nay ba 
ealeulaead aa 
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Tb* auebar wauXd XXka ea 


M cu etMek etia patlcloM of eh* p*l«* **4 
eh* laitvlAul ■•roa ea aa* whaebar aur 
taclaH hav* baan a*c« Th* pal* palpaaaial 

p<a) ■ tea Ua) * aaa L(a)( 


ak frot. M. K. 
Saia tor laeraAtalaf hta eo eha aaearlar aXgabra 
aa4 (or aaaaraX haXptei eanaaraaelau oa eha 
tttbjaaei tha auebar wtahaa aXao eo ebaak fra(. 

r. Vyaaa (or proviteag hXa «teb a aaeh*aael<* 
alaa'a vlaa o( aXgobrale *eevaeur*a> 


■ay ba obeaXoad, uatag eba eaapuead raXuaa a( ( 

aa4 I. aa 


p(a) • (**'^Jate)^<6.>2*ai2.M> 

- (r*>l0.07)(aa>l.«S). 

Thua ona o( eha poXaa ta ae <*10.07 whtob Xa eXoa* 
eo eh* tealrad vaXu* o( *10. V* waaead eha oehar 
poX* eo raaala ae *2; le haa aovad a XXeeXa, eo 
-1.S5, Xa eha proeaaa o( aeeoaaoteeXai a Xaaae* 
Kluaraa arror aolueXoa. Th* ewo XadXnduaX laroa, 
axi(a) aod fjjta). aay aXao ba eaXeuXaead; ehay 
ara (ouad eo b* ae *5.93 aad *9.1 raapaeeXvaXy, 
MhXeh ara eXoaa eo eha daaXrad vaXuaa o( *d and 
•5. 

COKCmSIOHS 

la ehXa papar w* hava eooaXdarad auXelvarX* 
abXa oaepue (aadbaek, aad leakad ae xe (tea eha 
vXawpoXae o( eh* aaearXor aorpbXaaa Xaducad ovar 
eh* pXaae aap and eh* (aadbaek aap. (roa ehla 
vaneaga poXne, u* hav* dartvad aapraaaXena (or 
eh* XndXviduaX eXoaad loop eraaa(ar (uneelooa. 
le Xa found ehae eha XndXviduaX eXoaad loop taroa 
ra a((aeead by eh* eorraapondlng XndXviduaX 
(aadfoeward xaroa and by eha taroa o( alnora 
(oraad (roa eha faadforward aaerta whlX* XneXud* 
lag ehaaa Individual taroa. Xa (ar a* (aadbaek 
la eoneamad. le la found ehae eh* XndXviduaX 
eXoaad loop taro* of eh* eranafar (uneeloa ra* 
Xaelng eh* ouepue eo eh* b^*> rafaranoa, aay. 
ar* noe affaeead ae all by (aadbaek (roa eha a^" 
ouepue eo eha b‘*> eooparlaon polne. Raehat, 
ehaaa taroa dopand on eh* aub*a*enx o( (aadbaek 
aXaaanea eorraapondlng eo (aadbadc (roa ouep.t^a 
oehar than eha a^** eo eoaparlaoa poXnea oehar 
than th* b'*>, and on eh* aaearXor aapa Xaduead by 
ehXa tub*aaerla. 

Th* axpraaaXona ehae hava boon darlvad (or 
eha Individual eXoaad loop taro poXynoalaX* and 
(or eh* poX* poXynoaXaX thouXd ehaaaaXvaa b* o( 
Inearaae boeaua* aany eXoaad loop ayaeoa tpaelfl- 
eaeXona ar* yae glvan In earaa o( tlngX* ehannaX 
aaeteaelona. In addition, howavar, eh* tbovo- 
aanelonad axpraaalona hava baan uaad In ehla 
papar, in eonjuneelon with unier*vaok (aadbaek, 
eo tenv* an Xearaeiv* algorleta (or alanXeanaoua 
polo* and XndlvlteaX t*ro*pXaeMane. A eoaputar 
progroa haa baan vrleean eo XapXoaane ehla algo* 
rleha, aad an aaaapXa o( root pXaeaaane, ualng 
ehla progna, appoara In eh* laetar pare o( ehla 
papar. 
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Hooiiaa or * nmwru Jtt oaxmi muMnun snotii* 


lUfhM Tutkavleh. TttaaM *. Uta|lM. HiehMj. K. S«U 
0«»*rtMac oi n*«trt<;al biriMMlM 
Ualvaratey •( itocr* Dim 
H oct* OaM. n 4tSSt 


AMTMrr 

Th« taaortaaca at aenUnatr aodal* (or aodal (oUowtni MChoka to provtloae ta cha aodara 
eutboCaa aagiao tnOuoery 4teeoeoi cha aaad (or rallabla eachalguat (or oaalioaar ao4al |ta- 
traeiea. Tliit para<^ rtaartt uaoa a soactaulat lavaacigaetaa alaaO ae Oavaiaflot roailnaar 
41((traaelal ao4aU uelllatai cha aaetoaa at ;ovar tarlaa u4 algabrale eaaaora. EarhatU 
at eha teu4y la aa ta avrUeacioa oi ehaaa 14ata la oaalXaaar aMal laaaractaa oalaf a raal' 
eiaa 4t(ieal eurba(ta tugiaa atauUeioa. 

IHTItOOVCriOH 

Xoaal (oUoirtag control tmtaa conaeteuea a toU4 baekbooa (or aueh at eiia caacral tork in 
aeOara aviation, laaltally, ona baa ?ba plane, vtileh nay ba aa alrfriM or ta an«laa-~or 
boeh etio tlr(rtaa ta4 cha aoftna ratar4o4 at an Incairtcta whola. Undar eartaia eendtelona. 

aueh aa eaaaaraeuraa , pratturaa, tad coBprtator tytada, cha plane nay ba laid to taeia(> ear* 

cam nonllaaar 41((aranelal tauaeiona. hortovar, aaay at cha vartalloa In e,.taa tauaciooa 
trt ralaead co ona anoehar chrough coaalleaitd nonllaaar upa. Ic la vtehia chit rtaga at 
aeetpetbla condltlona ehte any rtallaeic conerol lyaeta auae carry on let vork. Accordingly, 

vhan a conerol tytcaa raealvaa a rtguate eo chtaga laporeaae phyalcal euaaeielaa ulchio cha 

plane, ic auae arrtnga co 4o to In tueh a way chae cha plane aovaa eo cha now condlelon with* 
out ytolaelng lea Idaneicy, chae la. wlehoue Ittvlng cha ueapeabla ragloo at condietona any* 
whart along cha way. for taaaala, LI aleteuda la to ba changad, chan chit auae ba aeenaali- 
ahtd without aeall. Or, l( chruae la eo ba changad, it auae ba changad wtehoue parmcemg 
taettalva Lncrtaaaa in eurblna lalae ttnaaraeura, 

Tht rtaaon chae aodal (ollowlng control chlakmg ta to uaa(ul In luch tleuaelona la 4ua eo 
cha (ace chae cha aadala nay ba uaad eo pratcrlba bahavtora which ara In conaonanea wteh cha 
region at tectpeabla plane condlelena. Sehadulad ovar an oaoraelng anvalopa, aueh aodalt can 
aaaorb a larga part at conerol teraaa, and can (raa cha (aadback loop tar let prleary eaak at 
achieving teeuraey In cha praitnea at parnaerte uneartalnelaa and dlaeurbancta. 

Thlt papar 4aala with teudfat aa cha uaa o( algabrale canaori (l| (or ganaraelng a (tally at 
nonllnaar nadalt, Tha aala (taeurt at cha algabrale cantor Invalvat cha way chae ic glvat 
{round an dlnanalonalley In ardor to lalo advaneagat at llnaartey. Thta provldtt an argtn- 
..tad way at looking te txptnalon (omula and provtdaa a dlract ima with paroMCtr IdtneKl* 
cation caehnlquai (or imaar tauaeiona. laaleally, ona haa eo daalgn Inielal condlelont and 
conerol tlgnala In ordar co ataura chae cha nonimaar nadal will auepar(oca eha Untar nodal 
locally, aa wall aa arraagmg chae te ylald a Largar ragloa at aeeaptabla aodtimg. Such 
aodallng taarelaat nava bean tahlblead la [21 and [21 (or rapraatneaelvt o((*tlaulaeor ta* 
aapltt Our purpoaa hart, than. It ro apply cha eaehatduaa eo aenimaar aodal lanartelon 
utlng a raal'Claa dlgleal curboiaa engma tlaulaelon, tad eo pratme tana prallaiaary rtpra* 
taneaelvt ratulct. 

ALCtBiAic rrasoits a MoiLiac 

Vt illuaeraea oo« eha uaa at altabrale cantort la nonllnaar aodal building, utlllimg idata 
o( powar tarlta and cruacatlon tpproaiaatlona. To chit and. lee x t X ba cha n*vteeor at 
•eaett and u c 0 ba cha ••vtceor at Inpuei, whart X and 0 art real vector ipaeat. 2on* 
alder eha nonllntar ordinary ll((trtneial tpuaelon 


*Thli work wat aupooretd by cha Maelonal Aaronauelci and Spaca Adnlnlatraeion undar Orane 
ISC 3048. 
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t ■ 


( 1 ) 


M »U1 MiUM wUhaut l*M that tha ari|U ta m aaulUkrlua »aut a( (1). Tha ftaMtlaa 
( I 1 a U • X, uaaar tartato caalmaai «aa«aatiaaa taali «a aaairttalty U a aaUMathaM a< 
(0,0> la I a V. aay ka aapraaaaX la a aaaar aaataa aaaaaataa af twa varufelaa. Baa la laa 
aataciaaal aaaalaaiCT a( httaat a«aai ataari 4attvati«aai aair tka (itac faa rr, a( 

aaak aa aaaaaaiaa aaa ha aaatiy raaaraai. Haaavat, U aa aaalaf (ha uatvaraal kiUaaai (aa> 
tat arMuat (aaaetaa •• Iaa*l«U Ih.ll. aaara (ha a^laaaalaaal raai vactar aaaaa 
X • 0 la (ha caaaar ftahaac af X at(h 0. aa aaa aaaraaa (ha rlth( al4a af (l> la (ha 
caaaaat Itrm 


f(a,u) 





t (IMa k (laaa 


(Z) 


Tha aaia (aauwa af (Z) Uaa u (ha faat (ha( (ha ara IIiwm aa»a, (aailKadax aa ar> 
aarly craacaaaa af higaar atfar (ai«a la (ha aaaaaaiaa. tuan aiaaaaaa ara buiK aa hy Kar* 
adaa. aa far aaaaaZa (X • (X • U)) • U. 


/. mailaaar aafal af (1) eaa ha ab(alaa4 hy (fuaaadaa af (Z). fa allaw fur (hla (Z> aay ha 
alaallflaa hy lairakualaa (ha eaa Uaaar aaa t*]k ahaaa aadae la (ha( af H<|| (allaaaa hy 
CM (ualar •tidalleaeiaa hy l/Jikl. ThM, a llatar Uaadfleadaa yrablaa hay ha faiaala* 
caa via (ha aauadaa 

* • '‘■W ‘‘01 ‘■ZO ‘•U ‘‘OZ ‘•JO *T 


whara a. la a vaatar yarddaaah leea caaaar yrahuat carw le aa aaaeaartara arfar, |lvaa 

hy (I, i, I • a, ■ • u. v • a. a • i • «, ...). CaMlhar eht canaar yrahuea aaaariacah wich 
cha 1^2 aaa which la (aaaraeah hy alaMaea le X^ U • U. r.<r ctja caaa at n • ) aah a 
■ cha IZ aaalaala af x•u•u cenalac at caraa tueh aa c;al. eiaiW 2 . xiW 2 >>i. 

•a an. luc 4ua co cha eoafaieadvuy af lealar auldaUsadsa la (ha flalf chare aaiac chraa 
ra4uB4aa( caraai aUaiaadaa af ehaaa caraa raaulca la *a ak)aa( af daanaiaa (. ta iae> 
aral, cha nuaaar ■'f iladnae alaaaaea from each yraauee la ilvaa hy cha coahinacortal aa> 
praaalan 

, . ^e • 1 • I, . (a . r - l, ,,, 

(ar a coycaa af < and r caylaa af a la cha yroduee. Canaerueden af cha lyactB can- 
• laca a( •caeklaf chaaa aaiwaialc in cha vaeeor Cf co |lva a reducadMlaa varalan af (}). 
which aaouaea co a uaa af cha •yMaerlc caaaar altahra [5|. le la loyartaae ce naea char 

now cha oacrla Lj), la at raduead dan. eortMfoadlnt co cha rad'tead ardor cerueevre. 

Ta cooflaca cha eonaentedon af aur ayaroxiaaca ayataa. douaaldaJ. layuta ara ayyllcd co (1), 
tod CM aeaea aoiudoM ara aaaylad aa h aalaccad daa polnca. Thaae aaaplad vaiuae ara 
loaded ineo cha axh oaarlx Xy. Tha (Irac rowa af Xy are daearalnad Craa ehc. aaoylad 

vaiuae af x and ui cha raaainini a-<ii««> recta eooea^n aanaalala which ara auidyliaa 
af cha ancriaa af chaaa flrec a«a rowa. Tha nxh aacdx X la foraad hy loodlni darlvadvaa 

aaciaaeaa for 1^. l2 ^ ** ‘ha h dxM polnca. M an tiiuacradon, for an approx* 

loadon racaaolni up co ehlrd dafraa canaor product taraa wo have 

* • "-lo ‘‘01 ‘‘ZO ‘‘U Sz -:o ‘‘Zi Hz Hi*’ H • 


Tlia aaehod aawloyad hara to aolvtnt for cha coofflclane aatrla uaaa a tlaiuiar vaiua iacoo- 
poaldon af cM croaapoaa af X« co aoivo cha alalaal laaac-tauarao probiaa, ratumlai cha 
axp parddonad oaarlx of cm Lk. 

AfPUCATIOHi JXT Xhcrn IQWUTOK 


ta cha aodoilnf dlaeuaalOM co fallow aceandon wlii cancer around HAM' a OCSEX ("Oulxla"^— > 
^uiac. Clean. ^hort>haui £ep*rl>antai {n(lM >h]. roliowlni la cha avoludon at cur* 

hojac CO curhofan anelaea in alrerafc prepulalon, cha ZCSt anflna la an advanced curhofao 
dadfoM tpaelfleally for powared*llf c. ihort-haui alrerafc. Tha ansine lacorporacea aavar* 
ai now eoneopta aoe ail currancly uaod an curhofaM -:a aehleva .tpdaui afftdaaey u vail aa 
lulac, clean opcraclon. rciury uaaa of ZCSEC*eypa eMlnaa will ho on ahorc cake all and 
laaalai tSTOL) alrerafc, promialnj hrlfhcer proapecta tor coapaee aacropoUcan alrporta. 

An Ideal of anv propulalon ttauladon la co achieve ahaoluce reallxa tor uae In fllfhe tlau* 
lacora. To approach chla ideal reauirea 'tery deteilea dlilcal tlauladoM in che fora of 
eocntlax eoanucar protraaa. The |oal of cha OCSXE aiaulacor pro(rM aaplovad in chla itudv 
haa heen co aehteva real claa propulaloa tloulaclon co he uiad in alrerafc ilaulaeore wieh 
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uaiar>ck«««tM 

Par cfea laaipcical aa<al ca ka 4Uauaaa4. cha rtacaa mi aaatraU aafUrai ara u (aUam. 
ta$iaa acataa ara (ha aaabuacar aale eaataraeara aai raaar 4r»tmXM la (ha Utm af (ha laa 
(faad aah aaapraaaar aaaai. Caacrai laaaia ara (ha (ual aaeartaf (alra raalilan (thlah 4a> 
(amiaaa aaU kuraar iual tlaw), aaiala araa aacatah. ani a (aa pKah aafla Htmaaar (ar 
aaatral ai cha vartabla pKah (aa. Thu a (hraa-acata, (hramaaacral aaiai irtiX ka (anat« 
Utah. Mahal (araaUclau wU| ura chu (hru atacu ara awrutlr uahar tarudian*** 

bslM auradaa far (ha aahal UaaciflMdaa aaa (aha (u hula arfrauhaa. Vha aatlu al*» 
dacar aaf ka ru «Kh (ha laaa aluad. (bat la. with (ha ilcleaX (aacrallar lafuae fullr 
aaaradva, whlla daplP varrtaf (ha pamr iaaaah (ar, aaulvalanclT , (ha "thraada") akauc 
aam aaalllkrtu ralat- Pliara I lllucratu (hta aahau whara »a rayraaaat tha Mflaa 4y 
nauea ia taiw af tha t(ata« aa4 (hair 4artvad«aa. Tha rafaraua lapae paur iaaaad (PVU) 
la iapleiaa aa a alauaUal parturkadu whlah la (ur«. with plaat wMuraamia 1 ^,. iacar- 
alua (ha cantrallar ipuKlea. aa altarutlaa apprauh (ar tha aiaulatar aparatiaa lavalvu 
opaalat tha laap. afftadvaly iaudvadap (ka aaacrallar tad ladapaaPMCly iMardap cha 
tadtviiual eaniral laputa. Thia dtutlM la partrayai la Plpwra 2 whara va Uuart a eaa- 
(taat pamr iauad aai ''(um-aff” tha aaaerajlar ky aaudai tha eaatrallar atata iarlvadvaa 
with lara. la thia my alauaUal laputa, u, up ka laaartai aah aailu atataa okaarrah, 

la tha aataad appruah aMdaaah akaaa, which wa will adept Hara, aeallBaarttlaa at tha plaat 
ara ucitad whlah aipht othatviaa hawa kua laaa preaaueah hah tha eaaerellar bme la tha 
leap. Par hath oparadau cha anplu alaulatar la cu late the ataahy atata prler te any 
parturbadam la orhar te aatabllah aa oparadai palat. Tha laldal ceahldeaa tbu laaar- 
(tah (era tha palat af aspaulu far tha aadaa truautlae appraaludu la tha uahal (araw 
ladmi. 

SAKPu umrs 

In thia (laal laetlaa wa affar aa avarvlaw of tha proeahura (ar aa liaadfleaclon oatap ch« 
XSCI tlaulatar. Aa laadaeah la tha pracehlai taedan, (ha aparatlan af QCSR (ar purpoaaa 
a( aehal laaaradaa la (hla (tuhy la af tha typa dapletah la Plpura 2. Tha daulater la rua 
with a 1001 pour iaoaah (or «awaral aacaaha te tattle all traaalaact. Thia prohueaa tou 
aauillbrlu value whara a aah u taeh coulat af thru alauata. Ulthla tha 

illital (lauladoa pri^ria (ha eontrol varlaklu ara oulpulatU to that a aiauoiho'. iaput 
with teu aoplltuha tah (raauuey la luartah lata each Iaput ahaaaal. Llkawiaa, .la tcata 
varlablaa ara parturbah (roa thair tauilibrlu valuu aah thea toulah over tou Intarwal at 
tvaaly tpaeah pataca la tlu. Tha llffaraaea batvam (hue taaplah valuaa tah the torratpoa* 
lla« ahttlllbnu valuu (ora tha block af obaacwoh lata (ar the Ihaaelfleatloa proeahura. 

Tha harcvadva valuu are alaa actrucah llraeely (ru cha tlaulator at cha tlvm toula 
claaa to chat t cruaeadoa appraduclm, tueh u that (Ivm la (S), oay ba (oraulatah. Or- 
larlai af the alauata la Cf la af erleteal tapart (or Ihudfleadoa u wall u tloula- 
cien af tha ooiali a soaplata alierltha (or tuch u ardarlaf proeahura uy ba (ouah la '21. 

Valid'': -a teuhlu af a aohal "eiatac af tuaparlap aohal reaponaat to :rua ruponaaa a( tha 
tcata variablaa to parturbadt-. la tha laltlal teataa tah Iaput tlpnal parautart about cha 
potat at which tha aehal la ihudfloh. Hareevar, a tcoaharh Uaaar tpproaiueion aohal la 
oonally Umtifiah by taoehat uthoh tah alaa uaah la the eoapadaoa teuhlaa. All liaula- 
tiau hare ara hou la cha apm ,eop. for tkoopla. abaarva cha raaponaa survaa pivm la 
ftpuraa l-S- Tha (Irie plat rapraaaaca a toopla reapoaaa (or parcurbatiau la tha initial 
tcata voluui Plpura 1 thowa cha bahovtor of cha eonpruaor tpaah far t haertua to 291 at 
the parturbatioa uau la cha Ihutlfleacion. Plpura 4 rapraaaaca cha raapoot': af tha coa- 
praaaor tpaah (or a dowowarh parturbadon in tha control tipaal mplituhao. Plully, Plpura 
S txhibica cha (aa tpaah bahavtar (or a 20t lacraua la (ropuanciaa la tuh tlpnal. 

PraliaiaarT ttuhlat hove rmultoh la tavaral oonlioear oohela (ar tpaclfle lhaacifleaeiaa 
aolnca. To llluatraca cha typo of tlaulaeiona which raaule (roa tuch aohala, rapraaantatlva 
raaponaa eurvaa hova aaaa praaaatah with varlou Input puatacar tact (ar ana tuch aohal. A 
(Inal Ihanclfieation, t.hae la. ana with full validation teuhlaa, it turraacly andar lavaa- 
tlpation. 
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